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ANALYSIS OF CASE-LEVEL FOOD STAMP PROGRAM QUALITY CONTROL 

DATA 



EXECUTIVE SUMMARY 



This report examines the kinds, sources, and causes of errors present in Food Stamp 
cases. The report also describes the kinds of households represented, investigates the 
relationship between household characteristics and error patterns, and attributes the 
dollars in error to various types of error. The report was prepared by SRI International 
under contract to the Food and Nutrition Service of the U.S. Department of Agriculture. 

The report is based on data from the Food Stamp Program Quality Control (QC) system. 
These data result from semi-annual reviews of a random sample of individual Food Stamp 
Program household files. State QC reviewers investigate the actual circumstances of 
each sampled case, compare their findings to the information in the case file, and note 
any differences. Data on household characteristics, the source and type of errors in the 
case, and the total dollar amount in error are recorded for each case reviewed. 

The report analyzes nearly 75,000 QC cases drawn from forty states plus the District of 
Columbia. This was the largest, most complete sample of QC cases available when the 
analyses were conducted. Most cases are from April 1981 through March 1982, the most 
recent period for which data were available for the bulk of the states. When data from 
that period were unavailable, data from October 1980 through September 1981 were 
used. Below we highlight the main findings of these analyses. 

Error Patterns 

o Overall, about one-fourth of the cases contained an error. Many errors were 
minor and the dollar overpayment rate was 8.7 percent. The most prevalent 
kind of error was overissuance to eligibles (about 13 percent of cases), followed 
by underpayments to eligibles (about 7 percent) and payments to ineligibles 
(about 5 percent). 
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Error Patterns (continued) 

o Among cases with errors, the average overpayment was about $53, consisting of 
payments to ineligibles (averaging about $93) and overissuances to eligibles 
(about $38). Underpayments averaged about $33. 

o Mistakes related to the amount of the household's earned income were the 
largest source of first errors (about one-third of cases), followed by mistakes 
related to unearned income (about 24 percent) and deductions (about 20 
percent). 

o The majority of first errors (about 58 percent of cases) were client-caused, due 
largely to failure to report information. About 42 percent were agency-caused, 
due largely to failure to take action on reported information. 

o Public Assistance (PA) and Nonpublic Assistance (NPA) cases had different error 
patterns. Compared to NPA cases, PA cases: 

contained slightly fewer overpayment errors (16.0 percent vs. 18.5 
percent) Jsut marginally more underpayment errors (7.8 percent vs. 7.0 
percent); 

involved somewhat larger average overpayment amounts ($57.31 vs. 
$50.58), although there was no difference in underpayment amounts; 

were less likely to contain errors related to income or resources (56 
percent of first errors vs. 71 percent), but more likely to contain errors 
related to deductions and household size (40 percent vs. 26 percent); and 

were more likely to involve agency-caused errors (48 percent vs. 38 
percent). 

Household and Case Characteristics 

o Sample households averaged about 2.8 persons; about half had white heads of 
household, about 38 percent were black, and 9 percent were Hispanic. About 
one in five households had earned income, about 46 percent received public 
assistance or general assistance, 27 percent received social security or pensions, 
and about one-fourth reported liquid assets. 

A case may contain several errors (for example, the client underreported income and 
the caseworker also miscalculated the shelter deduction). The report analyzed the first 
error recorded for each case for two reasons: (i) they are almost always the most 
important and (ii) the appropriate weight for subsequent errors is unclear because the 
dollar amount of error is not partitioned among multiple error sources by QC reviewers. 

Although small, these differences— like the others reported here— are statistically 
significant. 
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Household and Case Characteristics (continued) 

o The average Food Stamp allotment was about $107- The average certification 
period was seven months. About 5 percent of the sample cases received 
expedited services in the review period. 

o PA households were larger, less likely to earn income or receive Social Security 
benefits, and more likely to have a nonwhite head of household than NPA 
households. PA households received larger allotments (due to larger household 
size and lower income) and slightly longer certification periods than NPA 
households, but were less likely to receive expedited services. 

Relating Household and Case Characteristics to Errors 

Household and case characteristics explained only a small portion of errors. The study 
analyzed the combined explanatory effect of household and case characteristics on 
several measures of error, including both the dollar amount and incidence of 
overpayment, underpayment and total errors. When combined, household and case 
characteristics never explained more than 9 percent of the variance of errors among 
individuals and usually explained only 3 percent of the variance. 



Although the combined explanatory power of household and case characteristics 
was quite weak, some characteristics nonetheless show a statistically significant 
relationship to error. These are described below. 

Households with more members had more overpayments and 
underpayments than households with fewer members. 

Households with a nonwhite head had more underpayments and more 
overissuances to eligibles than households with a white head (but there was 
little difference between whites and nonwhites in payments to ineligibles). 

For all types of income except Supplemental Security Income, households 
with income had more overpayments and underpayments, than did 
households without income. 



* 



The reader should not confuse variance with the "variances" reported by QC reviewers. 
We use variance in its statistical sense here. For the nontechnical reader, variance is a 
measure of the degree to which individual scores on a variable are spread around the 
average score. 
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Relating Household and Case Characteristics to Errors (continued) 

o Characteristics that were related to the amount of overpayments were often 
related to the amount of underpayments. Thus, these characteristics appear to 
be indicators of a general tendency toward error, and overpayments to a group 
of people are partially offset by underpayments to people in the same group. 

o Most characteristics were related to the amount of error and the incidence of 
error in a similar manner. Likewise, characteristics associated with 
overissuances to eligibles were usually associated with payments to ineligibles in 
the same direction. The only meaningful exception was in connection with 
household size: households with more members had higher payments to 
ineligibles but smaller overissuances to eligibles than households with fewer 
members. 

o The average amount of error was substantially higher several months after 
certification or recertification than at the time of, or in the first month after, 
re/certification. The average error amount was higher when the most recent 
action was initial certification rather than recertification. 

o These characteristics usually had a similar relationship to errors for both PA and 
NPA cases. The magnitude of the impact on errors of having earnings was 
substantially greater for PA cases than for NPA cases. 

Attributing Dollar Error to Sources of Error 

Under the QC system, reviewers only determine the total amount of error in a case. 
They do not apportion the dollar amount among the various types of error that may be 
present in a case. The report develops a regression-based analytical technique for 
attributing dollar error to sources of error. The application of this technique to the QC 
database results in the findings below. 

o Errors in earned income were even more important in accounting for dollar error 
than their simple frequency would suggest. Earned income errors accounted for 
22 percent of PA errors and 26 percent of NPA errors, but the size of the errors 
meant that earned income errors accounted for 39 percent and W percent of the 
cost of PA and NPA errors, respectively. 

o Over 70 percent of the dollar value of overpayments were attributable to client- 
caused errors. Approximately one-third of dollar overpayments were 
attributable to client-caused earned income errors. 

o Errors that occurred after the most recent certification (that is, errors due to 
an unreported change in client circumstances) were larger than those that 
occurred at the most recent certification (for example, due to incorrectly 
reported client cicumstances). 
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Conclusion 

This picture of the patterns of error, household characteristics, and the relationship 
among them should strengthen efforts to control errors in the Food Stamp Program. As 
findings are discussed by policymakers and program managers, implications for error 
control techniques should emerge. Understanding the substantial differences in the 
dollar value attributable to different sources of error should enable state and local 
officials to concentrate on identifying ways to reduce the most costly types of errors in 
the Food Stamp Program. 
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I INTRODUCTION 



The Food and Nutrition Service (FNS) of the U.S. Department of 
Agriculture (USDA) has contracted with SRI International to conduct an 
evaluation of methods to prevent certification and recertifi cation errors in 
the Food Stamp Program (FSP). A key activity in this study has involved 
surveys of directors, "key respondents," supervisors, and eligibility 
workers from a sample of approximately 900 local welfare offices in 38 
states. They have been asked to report on policies and procedures related 
to the FSP, characteristics of office organization and management, the 
nature and extent of staff training, and their own attitudes and 
backgrounds. These data will be related statistically to error rates from 
these offices to identify activities or office or staff characteristics that 
are effective in controlling FSP certification and recertifi cation errors. 

The dependent variables for this study, local office error rates, are 
based on data produced from the FSP quality control (QC) system. These data 
result from state QC reviews of a random sample of individual FSP household 
files. Data on household characteristics, the source and type of errors in 
the case, and the dollar amount of error are recorded for each case 
reviewed. From these individual cases we will construct aggregate variables 
for each office. 

However, before these individual case data are transformed into 
aggregate office-level variables, it is useful to understand how they 
operate at the individual level. The results of our analyses of individual 
QC review cases are reported here. 

More specifically, we have examined four questions: 

. What are the kinds, sources, and levels of error identified among 
these QC review cases? 
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What kinds of households are represented by these QC review cases 
and how do they compare to a broader Food Stamp population? 

How do household characteristics relate to FSP errors; are some 
kinds of households more often associated with errors, or larger 
errors, than other kinds of households? 

What kinds of errors lead to larger dollar errors? 

Each of these questions is addressed in order in the following four 
sections. Before reporting these results, however, we describe the QC data 
and the samples used. 



Quality Control Data 

The QC review data are derived from the quality control review data 
sheet (FNS Form 245)*, presented in Exhibit 1-1. This form is completed for 
each case selected for quality control review. These cases result from 
drawing independent random samples from the FSP caseload in each state; 
separate samples are drawn from active and negative cases. The sample size 
in each state varies with the size of the caseload with a minimum of 300 and 
a maximum of 2,400 each year for active cases and a minimum of 300 and a 
maximum of 1,600 for negative cases. FNS has provided these data to SRI in 
the form of data files which contain virtually all the information presented 
on Form 245. However, data have been partially recoded. For example, 
incomes and assets have been converted from continuous numbers to categories. 

The individual case QC data file provided to SRI contains six different 
components. Records are available for completed reviews of both active and 
negative cases (cases that were terminated or whose applications were 
denied) . 



This form replaced a similar earlier form in early 1981. Data elements 
are almost identical, however. 
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Active case records contain data on household incomes, assets, and 
characteristics, Food Stamp allotment, whether an error exists, the type of 
error (overissuance, underissuance, payment to ineligible), the amount of 
the error, and a description of the first error listed on Form 245. 
Negative case records contain no household income or asset information but 
do contain information about whether an error is present and a description 
of the first variance identified on Form 245. There are also components of 
the data file that describe each variance identified on Form 245 for 
completed reviews of both active and negative cases, demographic 
characteristics and income sources for each individual listed on Form 245 
for active cases with completed reviews, and each administrative deficiency 
identified for completed reviews of both active and negative cases. The 
data used in the analyses reported here involve only case-level data from 
active QC review cases. 



Samples Used in This Analysis 

The QC data are available for all states except New Hampshire for the 
period from October 1979 to September 1982. However, not all states have 
data for all 5 month review periods within that time span. This analysis is 
based on the data for the period from April 1981 to March 1982 because that 
is the most recent year for which data are available for the bulk of the 
states. Where data are unavailable for this period, data from October 1980 
through September 1981 are used. Forty-one states have data available for 
one of these 12-month time periods. Table 1-1 presents the number of 
completed reviews of active cases in each state in the sample for each 
5-month period in our 12-month study time frame. The columns underlined 
indicate the QC data used in the total sample analysis in this report. 

Our descriptive analysis {Sections II and III) presents error and 
household characteristics for all cases in these 41 states, which comprise 
the broadest sample available with reasonably recent QC data. We also 
present similar descriptive statistics for the subsample of cases from the 
900 areas in the 38 states that agreed to participate in our survey (this 
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Table 1-1 

NUMBER OF COMPLETED QC REVIEWS OF ACTIVE CASES IN EACH 6-MONTH SEGMENT 
IN OUR ANALYSIS PERIOD IN EACH STATE IN THE SAMPLE 



State 



Al abama 

Arizona 

Arkansas 

California 

Colorado 

Connecticut 

Delaware 

Dist. of Columbia 

Florida 

Georgia 

Hawai i 

111 inoi s* 

Iowa 

Kansas 

Kentucky 

Louisiana 

Maine 

Maryland 

Massachusetts* 

Michigan* 

Minnesota 

Mississippi 

Montana 

Nebraska 

Nevada 

New Jersey 

New Mexico 

New York 

North Carolina 

North Dakota 

Ohio 



10/80- 


4/81- 


10/81- 


3/81 


9/81 


3/82 


1,209 


1,184 


1,239 


1,060 


1,162 


1,158 


1,216 


1,237 


T77S3" 


1,122 


1,221 


1,270 


923 


947 





1/ZZT 


1.T59" 


1,115 


421 


388 


389 


709 


721 


~~ 


1,720 


1/208" 





1,246 


1,243 


1,239 


794 


730 


389 


1,439 


1/37B" 


1,337 





1,148 








932 


920 


1,358 


1.T7B" 


1,T4T 


1,243 


834 


756 


1,149 


1.TJ8T 


1,T54T 


1,221 


1,200 


1,167 





956 


401 


1,153 


1.T3T 


1,T30~ 


1,174 


TTX57T 


1,112 


1,197 


955 


1,186 


313 


79T 


310 


511 


"5TT 


"573" 


289 


75S 


7*9" 


1,242 


1.T75" 


l.TTT 


1,170 


1,090 


984 


1,163 


1,022 


1,707 


1,242 


943 


1,141 


149 


T3T 





1.79T 


1,726" 
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Table 1-1 (Concluded: 





10/80- 


4/81- 


10/81- 


State 


3/81 
1,208 


9/81 
1,202 


3/82 


Pennsylvania 


841 


Rhode Island 


686 


721 


683 


South Carolina 





897 


"879" 


South Dakota 


291 


273 


"~ 0" 


Texas 


1.T55" 


1,T4~6~ 


1,141 


Utah 


390 


401 


423 


Virginia 


1,232 


1,"27o" 


1,T9T 


Washington 


1,202 


1,309 





Wisconsin 


1,353 


1,373 


1,374 


Wyomi ng 


165 


157 


25 



TOTAL 



38,809 



38,942 



30,525 



States included among the 41 states for which QC data are available, but 
not among the 38 states in the study sample because they chose not to 
participate in the study's surveys. 
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will be the sample used in later project analyses). Similarities in the two 
samples increase our confidence that our study sample is representative of 
food stamp cases more broadly. Further regression analyses, reported in 
Sections IV and V are based on the larger sample in 41 states. 

The findings of our analysis of household-level QC data are discussed 
in the following sections. 
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II ELIGIBILITY AND PAYMENT ERRORS IN ACTIVE QC REVIEW CASES 



In this section we describe the error characteristics of active QC 
review cases. We examine the incidence of different kinds of errors, the 
dollar value of these errors, and the average percentage of the Food Stamp 
allotments that are paid in error for the study sample and the total 
sample.* Similarities in the two samples indicate that the study sample is 
a representative subset of the universe of FSP review cases. In addition, 
we distinguish errors in public assistance and general assistance (PA) 
cases** from nonpublic assistance (NPA) cases, because of the different 
regulatory and administrative constraints under which they operate. 



Error Characteristics of Active QC Review Cases 

When we compare errors in the study sample, based on data from about 
900 areas in 38 states, with those in the total sample, based on all areas 
in 41 states, we find no important differences between the types and sizes 
of errors in the two samples. Table II-l shows that the percentages of 
cases with different kinds of payment errors (payment to ineligibles, 
overissuance to eligibles, etc.) are very similar in the two samples. About 
one-fourth of the study sample cases and 24.6* of the total sample cases 
have some kind of error, and 17.5% and 17. 3%, respectively, involve 
overpayments. Cases with overissuances to eligibles (12.7* and 12.5%) 
exceed cases with underpayment errors (7.4% and 7.3%). 



* 
The study sample is cases from 900 local areas in 38 states that will be 

used in later project analyses. The total sample is all cases in the 41 

states that have QC data for our study period. 

The QC data base does not distinguish PA and GA cases. In this report, PA 
will refer to cases that receive either PA or GA. 
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Table II-l 
PERCENTAGE OF CASES IN ERROR BY ERROR CATEGORY 



Error Category 



Payments to ineligibles 
Overissuances to eligibles 
Total overpayments* 
Underpayments to eligibles 
Total errors 



Study 

Sample 

(N=53,923) 


Total 
Sample 
(N=74,797) 


4.8% + 


4.8% 


12.7 


12.5 


17.5 


17.3 


7.4 


7.3 


24.9 


24.6 



I.e., in 4.8% of the study sample cases, payments were 
made to ineligibles. 



• 
Sum of payments to ineligibles and overissuances to 
eligibles. 
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Table I 1—2 presents the mean dollar value of errors among error cases 
in the two samples, by error category. The largest difference between the 
two samples is only $0.86, about 2% of the dollar values. For both samples, 
the largest dollar errors are associated with payments to ineligibles (a 
mean error of approximately $93). The mean dollar error of all error 
cases—both overpayments and underpayments--! s about $47 for both samples. 
Underpayments (about $33) are almost equal in amount to overissuances to 
eligibles (about $38). 

The mean percentage of the Food Stamp allotments paid in error for the 
two samples are presented in Table I I -3. The largest difference between the 
two samples here is less than one percentage point for underpayment errors. 
The dollar value of overissuances to eligible households averages about 
one-third of the allotments to those households. Underpayment errors are 
more substantial. Dollars that should have been paid to eligible households 
but were not average about 56% of allotments to those households. In other 
words, the average household subject to underpayment errors received less 
than half of the benefits to which it was entitled. 

Table II-4 shows the distribution of errors in each of the two samples 
by source, cause, and timing. This table describes the first error listed 
for the case on the QC review form; in almost all states, the first error is 
the primary error which contributes most to the total dollar error in the 
case. Again, tne samples are very similar to one another. The greatest 
difference is in the percentage of error cases in which the first error is 
client-caused: 59.4* for the study sample, compared to 57.5* for the total 
sample. The most common source of the first error is earned income (about 
one-third of cases in both samples), followed by unearned income errors. 
The majority of errors (about 58%) are designated as client-caused and are 
most likely to result from unreported information (just under 40* in both 
samples). Not surprisingly, the majority of errors (about 59%) occur at or 
before recertification; once a case has undergone one or more recertifica- 
tions, fewer errors are found. 
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Table 1 1-2 
MEAN DOLLAR VALUE OF ERRORS AMONG ERROR CASES BY ERROR CATEGORY 





Study I 
Amount 

$93.21+ 


sample 


Total 


Sample 


Error Category 


Amount 
$93.46 


N 


Payment to ineligibles 


2,602 


3,605 


Over-issuances to eligibles 


$37.85 


6,833 


$37.99 


9,334 


Total overpayments* 


$53.84 


9,435 


$53.45 


12,939 


Underpayment to eligibles 


$33.69 


3,976 


$33.07 


5,485 


Total errors 


$47.86 


13,411 


$47.38 


18,424 



I.e., in the study sample, the mean amount paid in error to 
ineligibles was $93.21. 

r 

Sum of payments to ineligibles and overissuances to eligibles. 
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Table 1 1 -3 

MEAN PERCENTAGE OF FOOD STAMP ALLOTMENT 
PAID IN ERROR BY ERROR CATEGORY 







Study S 
Amount 

100.0% + 


ample 
N 


Total 


Sample 


Error Category 


Amount 
100.0% 


N 


Payments to ineligibles 


2,602 


3,605 


Overissuances to eligibl 


es 


33.4 


6,833 


33.3 


9,334 


Total overpayments* 




51.8 


9,435 


51.9 


12,939 


Underpayments to eligibl 


es 


56.6 


3,976 


55.8 


5,485 


Total errors 




53.2 


13,411 


53.0 


18,424 



I.e., 100% of the dollar value of the allotments to ineligibles was in 
error. (Ineligibles, by definition, should receive $0, so all of 
their allotment is in error.) One-third of the dollar value of 
overpayments to eligibles was in error. 

* 
Sum of payments to ineligibles and overissuances to eligibles. 
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Table 1 1 -4 

PERCENTAGE OF CASES IN ERROR BY SOURCE, CAUSE, 
AND TIMING OF FIRST ERRORS 







Study 


Total 






Sample 


Sample 


Error 




(N=13,368) 


(N=18,335) 


Source of Error 






Earned income 




34.2%+ 


33.7% 


Unearned income 




24.1 


24.4 


Resources 




5.9 


6.3 


Deductions 




19.6 


20.1 


Household size 




12.3 


12.0 


Other nonfinancial 




1.6 


1.5 


Computational 




2.1 


2.0 


Total 




1QUJ5 


ltfTO" 


Cause of Error 








CI ient-caused 








Information not re 


ported 


39.2 


38.2 


Incomplete reporti 


ng 


19.2 


18.5 


Other client error 




JL_9 


0.8 


Total 




59.4 


57.5 



Agency-caused 
Policy misapplied 
Failure to take action 
Arithmetic error 
Other agency error 
Total 



12.5 

22.1 

3.9 

40.6 



13.6 

22.9 

3.9 

42.5 



Timing of Error 
At/before recertification 58.9 

Since recertification 41.1 



59.2 
40.8 



I.e., in 34.2% of the error cases in the study sample, 
earned income was the source of the first error. 
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Error Characteristics of PA and NPA Cases 

Differences between PA and NPA cases generally are larger than those 
between the study sample and the total sample, but most are still quite 
small. As shown in Table II-5, eligibility errors occurred in a somewhat 
larger percentage of NPA cases than of PA cases (5.6% vs. 3.9%, 
respectively), and, overall, NPA cases are very slightly more likely than PA 
cases to have payment losses (12.8% vs. 12.1%). Conversely, PA cases are 
slightly more likely than NPA cases to involve underpayments to eligibles 
(7.8% vs. 7.0%). These small differences are reflected in the total 
percentage of cases with errors--23.7% for PA and 25.4% for NPA cases. All 
differences are statistically significant at the .01 level, primarily due to 
the large samples involved. 

An exception to the generally small PA-NPA differences is in the mean 
dollar value of the payments made in error to ineligibles (Table II-6): 
about $110 for PA cases, compared to only about $84 for NPA cases, 
approximately a 30% difference. This larger value for PA cases is probably 
explained by the larger size of PA households (see Section III), most of 
whom are households with children. PA cases also have somewhat larger 
average overissuances to eligibles than do NPA cases (about $41 vs. about 
$36), as well as larger mean overpayments (about $57 vs. about $51). 
However, the mean dollar values of underpayments are approximately equal for 
the two groups (about $33), as are the mean dollar values of all payment 
errors (about $49 for PA and about $46 for NPA). All PA/NPA differences are 
statistically significant at the .01 level, except for the value of 
underpayments to eligibles. 

Table I I -7 presents the mean percentage of Food Stamp allotments that 
is in error for PA and NPA cases. Consistently larger percentages of NPA 
allotments than of PA allotments are in error. Most notably, among NPA 
eligibles who were underpaid, the underpayment error amounted to an average 
of 67% of the correct allotment, whereas among PA eligibles who were 
underpaid, the error averaged only 44% of their correct allotment. 
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Table 1 1 -5 
PERCENTAGE OF PA AND NPA CASES IN ERROR BY ERROR CATEGORY 



Error Category 



Payments to ineligibles 
Overissuances to eligibles 
Total overpayments* 
Underpayments to eligibles 
Total errors 



PA 
(N=34,323) 


NPA 
(N=40,474) 


3.9% + 


5.6%** 


12.1 


12.8 ** 


16.0 


18.5 ** 


7.8 


7.0 ** 


23.7 


25.4 ** 



Sum of payments to ineligibles and overissuances to eligibles. 

I.e., in 3.9% of the PA cases in the sample, payments were made 
to ineligibles. 

Significantly different from PA at a < .01. 
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Table 1 1 -6 

MEAN DOLLARS IN ERROR AMONG PA AND NPA 
ERROR CASES BY ERROR CATEGORY 



Error Category 



PA 




NPA 




Amount 


N 


Amount 
$84.06** 


N 


$109.64+ 


1,327 


2,277 


40.52 


4,136 


35.89** 


5,190 


57.31 


5,463 


50.58** 


7,467 


32.82 


2,670' 


33.30 


2,815 



Payments to ineligibles 

Overissuances to eligibles 

Total overpayments* 

Underpayments to eligibles 

Total errors 49.27 8,133 45.85** 10,287 



I.e., the mean amount paid in error to PA ineligibles was $109.64. 

* 
Sum of payments to ineligibles and overissuances to eligibles. 

** 

Significantly different from PA at a < .01. 
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Table 1 1 -7 

MEAN PERCENTAGE OF FOOD STAMP ALLOTMENT 
PAID IN ERROR TO PA AND NPA CASES BY ERROR CATEGORY 



Error Category PA NPA 



Payments to ineligibles 
Overissuances to eligibles 
Total overpayments* 
Underpayments to eligibles 
Total errors 



100.0% + 


100.0% 


30.3 


35.2** 


47.2 


55.0** 


44.0 


67.0** 


46.2 


58.2** 



I.e., 100% of the dollar value of the allotments to ineligibles 
was in error. (Ineligibles, by definition, should receive $0, 
so all of their allotment is in. error.) 

* 
Sum of payments to ineligibles and overpayments to eligibles. 

Significantly different from PA at a <_ .01. 
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Similarly, among NPA cases with payment losses, the error amounted to an 
average of 55% of the correct allotment value, compared with 47.2% for PA 
cases. Across all error cases, 58. 2% of the dollar value of the NPA 
allotments were paid in error, versus 46.2% of the PA allotments. Except 
for payments to ineligibles, all PA/NPA differences are statistically 
significant at the .01 level. 

The distribution of PA and NPA error cases by the source, cause, and 
timing of the first error is shown in Table II-8. Not surprisingly, NPA 
errors are more likely than PA errors to involve earned income (37.4% vs. 
28.9%) or resources (8.6% vs. 3.5%). Relative to PA errors, NPA errors are 
somewhat more likely to be client-caused (52.4% of PA error cases vs. 61.6% 
of NPA error cases), perhaps reflecting the often less stringent 
documentation requirements for NPA cases than for PA cases. These NPA 
errors are slightly more likely than PA errors to be due to missing 
information or incomplete reporting and to occur at or before 
recertification (61.2% vs. 56.5%). On the other hand, PA errors are 
somewhat more likely than NPA errors to involve household size (16.5% of PA 
error cases vs. 8.5% of NPA error cases), perhaps due to the different 
definition of household size that applies to PA cases, creating some 
confusion and, hence, opportunity for error. PA errors are also more likely 
than NPA errors to involve deductions (23.6% vs. 17.3%) and to be 
agency-caused (47.6% vs. 38.4%) due to a failure to take action. 
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Table II-8 

PERCENTAGE OF ERROR CASES BY SOURCE, CAUSE, AND TIMING 
OF FIRST ERRORS IN NPA AND PA CASES 

Error PA NPA 



28. 9 + 


37.4** 


23.4 


25.0** 


3.5 


8.6** 


23.6 


17.3** 


16.5 


8.5** 


1.6 


1.4 


2.4 


1.7** 



Source of Error 

Earned income 
Unearned income 
Resources 
Deductions 
Household size 
Other nonfinancial 
Computational 

Total 100.0 100.0 

Cause of Error 

CI ient-caused 

Information not reported 
Incomplete reporting 
Other client error 

Total 52.4 61.6' 

Agency-caused 

Policy misapplied 
Failure to take action 
Arithmetic error 
Other agency error 

Total 47.6 38.4** 

Timing of Error 

At/before recertification 56.5 61.2** 

Since recertification 43.5 38.8** 



36.7 


39.3** 


14.7 


21.4** 


0.9 


0.8 



14.1 


13.2 


27.6 


19.2 


3.8 


4.0 


2.2 


2.0 



I.e., in 28.9% of the PA error cases, the first error was 
due to earned income. 

** 

Significantly different from PA at a < .01. 
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III FSP HOUSEHOLD AND PARTICIPATION CHARACTERISTICS 



In this section we describe selected characteristics of households 
whose active cases were subject to QC review in our 12-month analysis 
period. Characteristics of households in the study sample are compared to a 
broader sample of cases to determine if important differences exist.* 
Similarities in the two samples give us confidence that these and later 
study findings are relevant to FSP cases as a whole. We also compare 
characteristics of households who receive public or general assistance (PA) 
to those of non-public assistance households (NPA). This dichotomy is 
potentially important in understanding FSP error and error control 
activities, since program regulations and procedures differ for the two 
groups. 



Characteristics of the Study Sample 

Table III-l presents descriptive statistics on selected household 
characteristics of our study sample and the broader sample of QC cases. The 
table demonstrates the fundamental similarities in characteristics of the 
two samples. ; 

In both samples, households average just under three persons. 
Approximately half of the heads of household are white, while over one-third 



* 

The study sample includes cases from about 900 areas in 38 states. The 
larger sample, referred to as "Total Sample" in data tables, are all cases 
in 41 states for the 12-month analysis period. 
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Table III-l 
HOUSEHOLD CHARACTERISTICS OF ACTIVE QC REVIEW CASES 



Case Characteristics 



Average Household Size 

Ethnic Identification 
Percentage white 
Percentage black 
Percentage hispanic 
Percentage other 

Percentage of Households That Are; 
Al ien 
Migrant 



Income 

Percentage 
Percentage 
Percentage 
Percentage 
Percentage 
Percentage 
Security 
Percentage 
Percentage 
Percentage 



with earned income 

with any income 

with earned income >_ 2500 

receiving PA/GA* 

with PA/GA >_ 2200 

receiving Social 

or pension 

receiving SSI 

receiving other income 

wi th net i ncome 



Deductions 

Percentage with shelter deductions 
Percentage with medical deductions 

Percentage with Liquid Assets 



Study Sample 
Amount R 



Total S a mple 
Amount R 



2.7 53,892 



2.8 



74,762 



46.8 

39.1 

8.9 

5.2 


44,114** 
44,114 
44,114 
44,114 


50.3 

36.4 

8.6 

4.6 


59,594 
59,594 
59,594 
59,594 


4.6 
.0 


53,732 
53,732 


4.1 
.1 


74,537 
74,537 


22.3 
89.5 
11.7 
47.9 
31.4 


53,923 
53,923 
53,923 
53,923 
53,923 


21.9 
87.2 
11.2 
45.9 
30.4 


74,797 
74,797 

74,797 
74,797 
74,797 


27.0 
18.7 
14.7 
78.7 


53,923 
53,923 
53,923 
53,923 


26.7 
18.5 
13.4 
76.4 


74,797 
74,797 
74,797 
74,797 


86.3 
4.9 


53,923 
53,923 


84.0 
4.8 


74,797 
74,797 



24.2 53,923 25.8 



74,797 



Public assistance or general assistance. 

k 
The sample is smaller for ethnic variables because data were not included 

on the QC data form used in the first QC period included for some states 

in our analyses. 
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of the households are headed by black persons. The study sample has a 
slightly larger proportion of black heads of household and a smaller 
proportion of white heads of household than the larger sample, though these 
differences are quite small. Hispanic households and other ethnic groups 
make up about 14% of the sample. Migrant households comprise about 4% of 
both samples, while households with migrant workers are only about .1% of 
cases in the sample. 

The QC data contain information on several forms of income a household 
might receive. Table III-l indicates that although only about 22% of 
households reported receiving earned income, a large majority (about 88%) 
reported receiving some form of income. In most cases, reported incomes 
were small; only about 11% of cases reported earned incomes of $500 or more. 

Many of the households reported receiving unearned income from one or 
more sources. Just under half of the households reported receiving general 
assistance (GA) or public assistance (PA), primarily Aid to Families with 
Dependent Children (AFDC). For almost a third of the households, GA or PA 
benefits were $200 or more for the month. About 27% of households received 
Social Security or private pension benefits. Just over 18% of the 
households received Supplemental Security Income (SSI). Other sources of 
income were reported by about 14% of households. Once deductions were 
considered, just over three-quarters of the households (77%) reported having 
net income. 

In addition to an earned income deduction, major deductions in 
determining eligibility are allowed for shelter and medical expenses. About 
85% of households claimed a shelter deduction, while less than 5% claimed a 
deduction for high medical expenses. Liquid assets were reported by about a 
fourth of households. 



Participation Characteristics of FSP Households 

The QC data also offer some information on FSP households' 
participation in the program, as presented in Table 1 1 1—2- The average Food 
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Table III-2 
FOOD STAMP PARTICIPATION CHARACTERISTICS 



Case Characteristics 



Study Sample Total Sample 

Amount R Amount FT - 



Average Food Stamp Allotment 



2107.39 53,923 2106.49 74,797 



Percentage Receiving Expedited 
Services in Review Period 



5.4 53,789 5.2 74,614 



Percentage of Cases with Most Recent 
Action as: 

Initial certification 

Recertification 



25.4 53,923 25.1 74,797 

74.6 53,923 74.9 74,797 



Average Months in Certification Period 7.1 52,796 7.3 73,385 



Average Months Between 

(Re)Certification and Review 



3.9 44,103 3.8 59,499 
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Stamp allotment to sample households is about $107 for the month, or about 
$39 per person. During this one year period, about 5% of the households 
received emergency Food Stamp benefits under the expedited services 
provision of the program. 

About one-quarter of the cases included in the QC sample were reviewed 
after initial certification, but before recertification. The remaining 75% 
of cases had been recertified one or more times. The recertification period 
averaged just over 7 months for both samples. The average QC review was 
conducted about 4 months after the most recent case action. 



Characteristics of PA and NPA Cases 

Public asssistance (PA) cases are distinguished from nonpublic 
assistance cases in the regulations to which they are subject and often in 
the process by which they are handled in the local welfare agency. Here we 
also examine whether PA and NPA households themselves differ on important 
characteristics. 

Table I I 1-3 compares PA and NPA households in our total sample. PA 
households are larger, averaging 3.2 persons compared to 2.4 for NPA 
households. This is not surprising given that PA households are largely 
AFDC recipients with one or more children. Single-person households or 
those with no children are most often found in the NPA population. 

There are also noticeable ethnic differences between PA and NPA 
households. Black, Hispanic, and other nonwhite heads of household are more 
heavily represented in the PA population, while the NPA population is more 
predominantly white. The proportions of alien and migrant households do not 
differ between the two groups. 

Income sources and levels differ markedly between the two kinds of 
households. Only about 13% of PA households reported having earned income, 
whereas about 29* of NPA households reported earned income. This is perhaps 

III-5 



Table of Contents 



Table III-3 
HOUSEHOLD CHARACTERISTICS OF PA AND NPA CASES* 



PA 



NPA 



Case Characteristics 



Average Household Size 

Ethnic Identification 
Percentage white 
Percentage black 
Percentage hispanic 
Percentage other 

Percentage of Households That Are: 
Al ien 
Migrant 

Income 

Percentage with any income 
Percentage with earned income 
Percentage with earned income >_ 2500 
Percentage with PA/GA >_ JS200 
Percentage receiving Social 

Security or pension 
Percentage receiving SSI 
Percentage receiving other income 
Percentage with net income 

Deductions 

Percentage with shelter deductions 
Percentage with medical deductions 

Percentage with Liquid Assets 



Amount 


N 


Amount 
2.4 


N 


3.2 


34,305 


40,448 


41.8 

41.0 

11.1 

6.1 


26,185 
26,185 
26,185 
26,185 


57.0** 

32.8** 

6.7** 

3.5** 


33,402 
33,402 
33,402 
33,402 


4.1 
.0 


34,173 
34,173 


4.0 
.1 


40,355 
40,355 


98.4 

13.3 

4.7 

66.3 


34,319 
34,319 
34,319 
34,319 


77.8** 
29.2** 
16.7** 


40,469 
40,469 
40,469 


11.4 

7.2 

10.2 

85.0 


34,319 
34,319 
34,319 
34,319 


39.7** 
28.1** 
16.1** 
69.3** 


40,469 
40,469 
40,469 
40,469 


90.8 
12.8 


34,319 
34,319 


78.3** 
7.8** 


40,469 
40,469 



17.2 34,319 33.1** 40,469 



This table is based on the total sample of QC data from 41 states. 
Significantly different from PA at a < .01. 
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explained by the large number of female-headed households with young 
children in the PA population. Childcare responsibilities may prevent these 
mothers from working, reducing the proportion of households with earned 
income. Almost all PA households reported some income, as expected; by 
definition, they are receiving PA or GA benefits. Just over three-fourths 
of NPA households reported receiving any income. Income levels tend to be 
higher for NPA households; about 17% reported incomes for the month of $500 
or greater, while only about 5% of PA households reported incomes that 
high. The majority of PA households (66.3*), however, reported receiving PA 
or GA benefits of at least $200 for the month. 

The pattern of receipt of other benefits and income favors NPA 
households. Almost 40% of NPA households receive Social Security or other 
pension benefits compared to only about 11% of PA households; this is not 
surprising given that households with elderly members are much more likely 
to be in the NPA than the PA population. About 28% of NPA households 
receive SSI benefits, almost four times the 7.2% of PA households that 
receive SSI. Less marked differences are apparent in the receipt of income 
from other sources; about 10% of PA households and 16% of NPA households 
reported receiving other income. 

Balancing income against deductions, more PA households (85%) reported 
having net income than NPA households (69.3%). This is in spite of the 
larger proportion of PA households claiming shelter and medical deductions 
(90.9% and 12.8%, respectively) compared to NPA households (78.3% and 
7.8%). About one-third of NPA households reported liquid assets, almost 
twice the proportion for PA households (17.2%). 

In addition to PA and NPA households being different on these key 
eligibility factors, Table III-4 demonstrates that characteristics of their 
participation in the FSP also differ. PA households average a much larger 
monthly Food Stamp allotment ($126.76) than NPA households ($89.31). This 
may be explained largely by differences in household size. The average 
allotments per capita for PA households ($39.61) and NPA households ($35.96) 
are much closer in size. 
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Table 1 1 1 -4 

FOOD STAMP PARTICIPATION CHARACTERISTICS 
FOR PA AND NPA CASES* 



PA 



NPA 



Case Characteristics 



Average food stamp allotment 

Percentage receiving expedited 
services in review period 

Percentage of cases with most recent 
action as: 

Initial certification 

Recertification 

Average months in certification period 

Average months between 

(Re) certification and review 



Amoi 


jnt 
76 


34, 


319 


Arnot 
289. 


int 

31** 


N 


126 


40 


469 


2 


6 


34, 


228 


7. 


3** 


40 


,377 



19.5 


34,319 


29.8** 


40,469 


80.5 


34,319 


70.2** 


40,469 


7.6 


33,230 


7.0** 


40,147 



3.9 



26,363 



3.7** 33,130 



This table is based on the total sample of QC data from 41 states. 
Significantly different from PA at a < .01. 
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A larger proportion of NPA households (7.3j) received expedited 
services for the review period than was true for PA households (2.6*). The 
PA or GA benefits received by PA households act as a buffer against the dire 
straights that are necessary to qualify for expedited services. 

About 80% of PA cases had been recertified for Food Stamp benefits at 
least once, compared to about 70% for NPA cases. PA cases also average 
slightly longer certification periods than their NPA counterparts (7.6 and 
7.0 months, respectively). There are no important differences between the 
two types of cases in the average number of months between certification or 
recertification and the QC review. 

In the next section, the types of errors reported in Section II are 
related to the household and participation characteristics described here to 
identify whether any of them are important predictors of error. 
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IV THE RELATIONSHIP BETWEEN HOUSEHOLD CHARACTERISTICS AND ERRORS 



In this section we examine how household characteristics affect the 
likelihood and amount of error. Thus, we examine whether some types of 
cases are more susceptible to error than other types of cases. The analysis 
explores the relationship between case characteristics and both the dollar 
amount of error and the probability of error for each of five types of error: 

. Overpayments, which are subdivided into: 

- Overissuances to eligibles, and 

- Payments to ineligibles. 

. Underpayments, and 

. The total error (the combination of overpayments and underpayments). 

The case characteristics used in the analysis include virtually all 
those available in the QC data and discussed in earlier sections, including 
demographic characteristics, the presence of incomes, deductions and 
resources, the Food Stamp allotment, and some measures of the frequency and 
recency of certification and recertifi cation.* In the following subsections 
we describe the model used in the analysis and present the results. 



The Model 



We conducted our analysis by estimating models in which error amounts 
and binary variables indicating the presence of an error are the dependent 



* 
Because data on individual family members were not available for all 
states in the sample, our analysis does not use data on the age and sex of 
family memebers. 
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variables, and case characteristics are the independent variables. The 
dependent variables used in the analysis are: 

. Amount of error, 

- Dollar overpayments (to both eligibles and ineligibles) , 

- Dollar overissuances to eligibles, 

- Dollar payments to ineligibles, 

- Dollar underpayments, 

- Total dollars in error (sum of overpayments and underpayments, 

Incidence of error—Binary variables indicating: 

- Whether an overpayment error occurred, 

- Whether an overissuance to an eligible occurred, 

- Whether a payment to an ineligible occurred, 

- Whether an underpayment error occurred, 

- Whether any error (underpayment or overpayment) occurred. 

Thus, the dependent variables include both measures of the amount of 
error and of the incidence of error and distinguish between underpayments 
and overpayments and between payments to ineligibles and overissuances to 
el i gibl es. 



The independent variables incorporated in the analysis are: 

. Demographic characteristics 

- Number of household members, 

- Whether the household contains an alien, 

- Binary variables indicating the race of the head of household, 
including white, black, Hispanic, and other nonwhite. 

. Binary variables indicating the presence of income types, including 

- Earned income of less than $500 a month, 

- Earned income of more than $500 a month, 

- RSDI (Social Security), or pensions. 

- Supplemental Security Income (SSI), 

- Other income, 

. Binary variables indicating the presence of deductions, including: 

- Shelter expense, and 

- Medical expense. 
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. A binary variable indicating whether the household has net income 
(income in excess of deductions), 

. A binary variable indicating whether the household has liquid 
resources, 

. The amount of the Food Stamp allotment, and 

. Variables describing the frequency and recency of certification and 
recertifi cation, including: 

- The length of the certification period in months, 

- A set of binary variables indicating the length of time from 
certification to QC review for cases whose most recent action was 
initial certification—Certified the same month or 1 month before 
QC review, certified 2-3 months before QC review, certified 4-6 
months before QC review, and certified 7 or more months before QC 
review, and 

- A set of binary variables indicating the length of time from 
recertification to QC review for ongoing cases— Recertified the 
same month or 1 month before QC review (the "left out" category), 
recertified 2-3 months before QC review, recertified 4-6 months 
before QC review, and recertified 7 or more months before QC 
review.* 

While there is no a priori reason to expect a relationship between 
errors and demographic variables such as household size and race, we do 
expect a relationship between errors and the presence of income and 
deductions and the variables representing the frequency and recency of 
certification and recertification. Food Stamp cases with incomes and 
deductions are more complex and, hence, may be more susceptible to error. 
For example, in a case with several different types of income, there are 
possibilities for e<*ror in each type of income; the computation of the Food 
Stamp allotment is also more difficult and, hence, more susceptible to 
error. One would also expect that cases are more likely to be in error 
several months after certification or recertification than during the month 



The binary variables for length of time from certification to QC review 
and from recertification to QC review together are mutually exclusive and 
exhaustive. That is, each case falls into one and only one of these 
categories. Hence, for each case one of these variables is one and the 
others are zero. Because the category excluded from the model is 
recertified in the same month or 1 month before review, the coefficients 
of the other variables measure the difference in errors relative to cases 
that were recertified in the same month or 1 month before the QC review. 
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of certification or recertif ication because the passage of time will often 
result in changes in the household's circumstances which may not be reported 
by the household or acted on by the agency in a timely fashion. The 
household's assigned certification period may also be related to errors. 
Food Stamp agencies generally assign shorter certification periods to those 
cases they believe are more likely to have changes in circumstances. Hence, 
cases with longer certification periods should be less susceptible to error. 

In addition to the independent variables described above, several other 
variables were incorporated into the model, although they are not presented 
in the tables of results. These variables include the following: 

Binary variables for time period — These variables are intended to 
account for trends over time in the error rate due to either changes 
in economic conditions or changes in Food Stamp program 
regulations. While there are occasional differences among periods 
in the amount or incidence of error, there is no general time trend. 

A binary variable indicating use of the old QC review form—Several 
of the variables used in the analysis (race and months from 
recertif i cation to review) are available only on the new QC review 
form. Most states in our sample implemented this form before 
April 1, 1981 when our analysis period began for most states. 
However, our sample does include the previous 6 months for a few 
states, and several states did not implement the new form until a 
later date. For these states and periods, variables available only 
on the new form are missing. Hence, we set these variables to equal 
the mean over all cases, and included in the model a binary variable 
indicating that the new form was used. 

. A binary variable for coding errors in months from certification to 
review — In several states, months from certification to review was 
miscoded on the QC data files so that all we know is whether the 
time since certification is 1 month, 2 months, 3 months, or more 
than 3 months. Thus, for many cases we know that it has been more 
than 3 months since re-certification but we cannot distinguish 
between 4 months and 6 months and 9 months. To account for this 
problem, we treated these cases as having been recertified 6 months 
earlier, and included in the model a binary variable indicating that 
this assumption has been made. 



The basic model used to estimate the relationship between errors and 
the case characteristic is a multiple regression model in which the 
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dependent variable is an error amount or an indicator of the presence of an 
error and the independent variables are case characteristics. The model can 
be written as: 

E = a+bX + e 

where E is the dependent variable (such as the dollar overpayment, X is a 
vector of independent variables, e is an error term, a is a constant term, 
and b is a vector of parameters representing the effects of the case 
characteristics on errors. 

We estimated this model using ordinary least squares (OLS). While this 
statistical technique is appropriate when the dollar amount of the error is 
the dependent variable, it suffers from some deficiencies when the dependent 
variable is a binary indicator of the presence of an error. First, 
predicted probabilities can fall outside of the interval from to 1. 
Second, the error terms are necessarily heteroscedastic (i.e., the variance 
of the error term varies among cases); consequently, the estimates of the 
standard errors of the parameters are biased. Despite these disadvantages, 
OLS estimates are used because they are relatively simple to compute and 
easy to interpret. To assess the sensitivity of our results to the use of 
ordinary least squares, we present a comparison of OLS estimates to 
estimates of a logit model in Appendix A. The results in that appendix 
indicate that the OLS and logit models have very similar implications. 

i 
The sample used for the analysis in this section includes all cases in 

the total sample, except cases that received expedited service. These cases 

are excluded because the definition of an error is different for cases that 

received expedited service in the month of review. The resulting sample 

contains 37,501 NPA cases and 33,442 PA cases. 

Because the nature and intensity of certification and recertification 
procedures differ for PA cases and NPA cases, we investigated whether 
separate models should be estimated for these two types of cases. This 
investigation was conducted by estimating a combined regression model 

IV-5 



Table of Contents 



(including an indicator of receipt of Public Assistance or General 
Assistance payments) for the entire sample and separate models for the PA 
and NPA subsamples and conducting an F-test of the null hypothesis that the 
coefficients of all variables except the intercept were the same. This null 
hypothesis was rejected at the 1% level (F = 11.9 with 28 and 70885 degrees 
of freedom for the total dollar error). Thus, we present estimates of 
separate models for NPA and PA cases.* 



Results 

The results of our analysis are presented in Tables IV-1 through IV-4. 
Table IV-1 presents the estimated effects of the case characteristics on the 
total dollar error (the sum of overpayments and underpayments), the amount 
of underpayment error, and the amount of overpayment error (to both 
eligibles and inel igibles). Table IV-2 partitions the estimated effects on 
dollar overpayment errors into effects on overi ssuances to eligibles and 
payments to inel igibles.** Table IV-3 presents the effects on the incidence 
of any error, underpayment errors, and overpayment errors and is comparable 
to Table IV-1. Finally, Table IV-4 presents the estimated effects on the 
incidence of overissuances to eligibles and payments to inel igibles and is 
comparable in form to Table IV-2. 



Preliminary analysis, which did not allow interactions between the most 
recent case action and months since recertification to review, indicated 
significant differences in the coefficients of the variables representing 
months between recertification and review. However, differences in the 
coefficients of other variables between the initial certification and 
recertification subsamples were small. For this reason, we included 
interactions between certification/recertification and months from 
recertif ication/certification to review in the model rather than estimate 
separate models for initial certifications and recertifications. 

** 
The estimated effects on overpayment error appear in both Tables IV-1 and 

IV-2 to demonstrate the partition of overpayments into overissuances to 

eligibles and payments to inel igibles and the partition of total error 

into underpayments and overpayments. 
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Table IV-1 

ESTIMATED IMPACT OF CASE CHARACTERISTICS ON AMOUNT OF UNDERPAYMENT ERROR, 
OVERPAYMENT ERROR AND TOTAL ERROR FOR NPA AND PA CASES 



Amount of Error (Dollar Impacts) 



' 




NPA Cases 






PA Cases 






All 
Error 


Under- 
payment 


Over- 
payment 


All 

Error 


Under- 
payment 


Over- 
payment 


Case Characteristics 














Demographic characteristics 




Household size 


$1.91** 


J1.20** 


$0.71** 


$1.03** 


$1 .07** 


$-0.04 


Whether aliens 


0.62 


0.38 


0.24 


0.71 


-0.54 


1.25 


Race 














White 
Black 
Hispanic 
Other nonwhite 


1.53** 
2.20** 
0.31 


0.46** 
. 0.02 
1.34** 


1.07** 
2.18** 
-1.02 


2.89** 
2.21** 

0.58 


0.96** 
1.06** 
1.18** 


1.93*" 
1.15 
-0.59 



Whether have income 

Earned income 

Less than $500/month 
$500/month or more 

RSOI or pensions 

SSI 

Other Income 
Whether have deductions 

Shel ter 

Medical 

Whether have net income 

Whether have liquid resources 

Food Stamp allotment amount 
(SlOO's) 



2.12** 0.93** 1.19** 

3.81** 1.56** 2.24** 

0.45 -0.58** ' 1.04* 

-3.01** 0.40* -2.62** 

2.36** 0.78** 1.58** 

2.64** 0.16 2.47** 

0.44 -0.30 0.75 

0.44 0.60** -0.16 

-1.56** -0.68** -0.88** 

6.61** -2.08** 8.69** 



7.43** 3.43** 4.00** 

9.71** 3.22** 6.48** 

3.04** 0.34 2.70** 

0.75 -0.02 0.77 

0.71 1.12** -0.41 

0.39 -0.59* 0.98 

-2.04 -3.24** 1.20 

1.95** 0.47* 1.48*- 

-1.97** -1.19** -0.79 

4.00** -2.23** 6.24** 
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Table IV-1 (Concluded) 



Case Characteristics 

Certification characteristics 

Length of certification 
period 

Time from certification to 
QC review for initial 
certi fications 



Certified same month or 

1 month before review 
Certified 2-3 months 

before review 
Certified 4-6 months 

before review 
Certified 7 or more 

months before review 

Time from recerti fication 
to QC review for ongoing 
cases 

Recertified same month 

or 1 month before 

review 
Recertified 2-3 months 

Defore review 
Recertified 4-6 months 

before review 
Recertified more than 7 

months before review 



Amount of Error (Dollar Impacts) 



NPA Cases 



PA Cases 



All 
Error 



0.03 



Under- Over- 
payment payment 



All Under- Over- 
Error payment payment 



-0.08* 



0.11 



-0.20* 



-0.02 



4.81** 1.40** 
5.84** 1.44** 
4.73** 1.01** 



-0.19* 



0.25 


-.31 


0.56 


1.25 


0.42 


0.82 


6.07** 


1.18** 


4.89** 


3.85** 


0.40 


3.45 


11.17** 


2.07** 


9.10** 


6.98** 


1.47 


5.51 


6.45** 


0.69 


5.75** 


5.62** 


0.80 


4.82 



3.41** 


2.00** 


0.28 


1.73** 


4. 40** 


3. 04-* 


0.51 


2.54— 


3.71" 


4.55** 


0.85— 


3.71** 



F-ratio 

Average amount of error 



0.09 0.03 0.07 

129.48** 44.05** 106.94** 

11.92 2.44 9.48 



0.04 0.03 0.03 

44.59** 38.37** 33.47** 
11.75 2.57 9.18 



•Significant at the 5% level. 
—Significant at the 15 level. 
Note: Estimated standard errors are presented in Table B-l . 
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Table IV-2 

IMPACT OF CASE CHARACTERISTICS ON AMOUNT OF OVERPAYMENT ERROR 
TO ELIGIBLES, INELIGIBLES AND OVERALL FOR NPA AND PA CASES 



Case Characteristics 
Demographic characteristics 
Household size 
Whether aliens 



Amount of Overpayment Error (Dollar Impacts) 



NPA Cases 



PA Cases 



All EUgibles Ineligibles All Eligibles Ineligibles 



JO. 71** $-0.48** $1.20** $-0.04 $-0.67** $0.63** 
0.24 0.13 0.11 1.25 1.18* 0.06 



Race 



White 
Black 
Hispanic 
Other nonwhite 



1.07** 


1.05** 


0.02 


1.93** 


1.15** 


0.78 


2.18** 


1.62** 


0.56 


1.15 


1.12** 


0.03 


1.02 


0.02 


-1.05 


-0.59 


-0.30 


-0.29 



Whether have income 

Earned income 

Less than $500/month 
$500/month or more 

RSDI or pensions 

SSI 

Other income 



1.19* 


1.18** 


0.02 


4.00** 


2.90** 


1.09* 


2.24** 


1.67** 


0.58 


6.48** 


4.20** 


2.28** 


1.04* 


0.68** 


0.36 


2.70** 


2.23** 


0.47 


2.62** 


-0.98** 


-1.64** 


0.77 


1 . 54** 


-0.77 


1 . 58** 


0.74** 


0.84* 


-0.41 


0.15 


-0.56 



Whether have deductions 

Shelter 

Medical 
Whether have net income 
Whether have liquid resources 

Food Stamp allotment amount 
($10O's) 



2.47** 


1.30** 


1.18** 


0.98 


0.07 


0.91 


0.75 


0.69* 


0.06 


1.20 


-0.69 


1.89 


0.16 


0.47 


-0.63 


1.48** 


0.88** 


0.60 


0.88** 


-0.84** 


-0.04 


-0.79 


-0.42 


-0.37 


8.69** 


6.73** 


1.96** 


6.24** 


6.20** 


.04 
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Table 1V-2 (Concluded) 



Amount of Overpayment Error (Dollar Impacts) 



Case Characteristics 

Certification characteristics 

Length of certification 
period 

Time from certification to 
QC review for initial 
certi fications 

Certified same month or 

1 month before review 
Certified 2-3 months 

before review 
Certified 4-6 months 

before review 
Certified 7 or more 

months before review 

Time from recertification 
to QC review for ongoing 
cases 

Recertified same month 

or 1 month before 

review 
Recertified 2-3 months 

before review 
Recertified 4-6 months 

before review 
Recertified 7 or more 

months before review 



F-rat1o 

Average amount of error 



NPA Cases 



PA Cases 



All 



0.11 



Eligibles Ineligibles 



All 



El igibles Inel igibl es 



0.16* 



3.41** 1.79** 

4.40** 2.21** 

3.71** 2.13** 

0.07 0.07 

106.94** 93.39** 

9.48 4.69 



-0.05 



-0.19** -0.12** 



-0.07 



0.56 


0.30 


0.26 


0.82 


0.20 


0.63 


4.89** 


2.48** 


2.41** 


3.45** 


1.40 


2.05 


9.10** 


4.06** 


5.03** 


5.51** 


2.06* 


3.45 


5.75** 


2.69** 


3.06** 


4.82** 


2.36* 


2.46 



1.62** 


1.73** 


0.94** 


0.79 


2.19** 


2.54** 


1.12** 


1.41 


1.58** 


3.71** 


2.83** 


0.87 


0.03 


0.03 


0.04 


0.01 


35.33** 


33.47** 


48.1** 


5.97 


4.79 


9.18 


4.92 


4.26 



♦Significant at the 51 level. 
"Significant at the It level. 
Note: Estimated standard errors are presented in Table 8-2. 
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Table IV -3 

ESTIMATED IMPACT OF CASE CHARACTERISTICS ON THE INCIDENCE OF OVERPAYMENT ERRORS, 
UNDERPAYMENT ERRORS, AND ALL ERRORS FOR NPA AND PA CASES 



Incidence of Errors (Percentage Point Impacts) 







NPA Cases 


PA Cases 






All 


Under- Over- 


All 


Under- 


Over- 




Errors 


payment payment 


Errors 


payment 


payment 


Case Characteristics 












Demographic characteristics 




Household size 


3.15** 


1.85** 1.35** 


1.85** 


2.05** 


-0.25 


Whether aliens 


-0.4 


0.3 -0.7 


1.9 


-0.8 


2.7* 



Race 



White 
Black 
Hispanic 
Other nonwhite 


4.1** 
3.2** 
1.7 


1.2** 
0.2 

1.9* 


3.0** 
3.5** 
-0.2 


' 5.6** 
4.1** 
3.6** 


2.0** 
2.1** 
2.9** 


3.6** 

2.0* 

0.7 


Whether have income 














Earned income 














Less than $500/month 
$500 /month or more 


10.4** 
10.2** 


3.8** 

3.0** 


6.6** 
7.3*- 


20.0** 
18.7** 


9.3** 

5.4** 


10.8** 
13.4** 


RSDI or pensions 


0.4 


-1.5** 


1.9** 


6.0** 


0.6 


5.5** 


SSI 


-8.0** 


-1.5** 


-6.5** 


4.0** 


1.1 


3.0** 


Other income 


5.1** 


2.6** 


2.4** 


5.1** 


4.6** 


0.5 


Whether have deductions 














Shelter 


3.7** 


-0.8* 


4.6** 


3.1** 


-1.7** 


4.8** 


Medical 


3.3** 


-0.7 


4.1** 


-7.9** 


-8.4** 


0.5 


Whether have net income 


4.3** 


3.8** 


0.5 


6.5** 


3.1** 


3.3— 


Whether have liquid resources 


-3.5-* 


-1.7** 


-1.8** 


-4.7** 


-2.9** 


-1.8** 



Food Stamp allotment amount 
(SlOO's) 



0.2 



-3.6** 3.8** 



-1.1 



-4.8» 



3.7** 
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Table IV-3 (Concluded) 



Case Characteristics 

Certification characteristics 

Length of certification 
peri od 

Time from certification to 
QC review for initial 
certifications 

Certified same month or 

1 month before review 
Certified 2-3 months 

before review 
Certified 4-6 months 

before review 
Certified 7 or more 

months before review 

Time from recertification 
to QC review for ongoing 
cases 

Recertified same month 

or 1 month before 

review 
Recertified 2-3 months 

before review 
Recertified 4-6 months 

before review 
Recertified 7 cr more 

months before review 



F-ratio 

Percent of cases in error 



Incidence of Errors (Percentage Point Impacts) 
NPA Cases PA Cases 



All Under- Over- 

Errors payment payment 



All Under- Over- 

Errors payment payment 



0.3* 



-0.1 



0.4* 



-0.2** 



0.0 



-0.3* 



-0.6 


-0.4 


-0.3 


2.5 


2.1* 


0.4 


7.4** 


1.9** 


5.5" 


4.0** 


0.4 


3.6** 


16.8** 


4.6** 


12.2** 


10.0** 


3.8** 


6.3" 


14.4** 


1.0 


13.5** 


10.3** 


3.3** 


7.0** 



7.4** 


2.8** 


4.7** 


3.1** 


0.8 


2.3 


11.2" 


3.6** 


7.6** 


5.5** 


1.4* 


4.1 


8.6** 


2.7** 


5.9** 


8.5" 


1.9" 


6.6 


6.9 


2.9 


4.4 


5.0 


3.4 


2.4 


98.6 


39.4 


62.0 


63.2 


42.0 


29.8 


25.2 


7.6 


17.6 


23.9 


7.8 


16.0 



•Significant at the 54 level. 
"Significant at the 1* level. 
Note: Estimated standard errors ire presented 1n TaDle B-3. 
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Table IV-4 

IMPACT Of CASE CHARACTERISTICS ON THE INCIDENCE OF OVERPAYMENT ERRORS TO 
ELIGIBLES, INEL1GIBLES, AND OVERALL FOR PA AND NPA CASES 



Incidence of Overpayment Errors (Percentage Point Impacts) 







NPA Cases 






PA Cases 






All 


Eligibles 


Ineligibles 


All 


Eligibles 1 


neligibles 


Case Characteristics 














Demographic characteristics 




Household size 


1.35** 


-0.25 


1.5%** 


-0.25 


-0.85** 


0.65** 


Whether aliens 


-0.7 


-0.7 


-0.0 


2.7* 


2.0* 


0.8 


Race 














White 
Black 
Hispanic 
Other nonwhite 


3.0** 
3.5** 
-0.2 


2.7** 
2.8** 
0.0 


0.2 

0.7 

-0.3 


3.6** 

2.0* 

0.7 


2.4** 

1.8* 

0.7 


1.1** 

0.2 

0.0 



Whether have income 
Earned income 

Less than J500/month 
J500/month or more 

RSDI or pensions 

SSI 

Other income 
Whether have deductions, 

Shelter 

Medical 

Whether have net income 

Whether have liquid resources 

Food Stamp allotment amount 
(JlOO's) 



6.6** 
7.3** 


5.3** 
6.1** 


1.3** 
1.1* 


10.8** 

13.4** 


8.6** 
9.7** 


2.1 
3.6 


1.9** 


1.2* 


0.8* 


5.5** 


5.1** 


0.4 


6.5** 


-3.1** 


-3.4** 


3.0** 


3.5** 


-0.5 


2.4** 


1.1* 


1.3** 


0.5 


0.9 


-0.4 


4.6** 


3.7** 


0.9* 


4.8** 


3.8** 


1.0 


4.1** 


3.6** 


0.5 


0.5 


-1.2 


1.7 


0.5 


0.9 


-0.4 


3.3** 


3.1** 


0.2 


1.8** 


-2.2** 


0.4 


-1.8** 


-1.6** 


-0.1 



3.8** 



7.9** 



-4.1* 



3.7* 



6.2* 



-2.5* 
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Case Characteristics 

Certification characteristics 

Length of certification 
period (months) 

Time from certification to 
OC review for Initial 
certifications 

Certified same month or 

1 month before review 
Certified 2-3 months 

before review 
Certified 4-6 months 

before review 
Certified 7 or more 

months before review 

Time from recertification 
to QC review for ongoing 



Table IV-4 (Concluded) 

Incidence of Overpayment Errors (Percentage Point Impacts) 
NPA Cases PA Cases 



All Eligibles Ineligibles All Eligibles Ineligibles 



0.4** 0.5** -0.1 



-0.3** -0.2* 



-0.1 



-0.3 


-0.5 


0.3 


0.4 


-0.3 


0.7 


5.5** 


2.7** 


2.8** 


3.6** 


1.7 


1.8 


12.2** 


6.7** 


5.6** 


6.3** 


3.2** 


3.0 


13.5** 


8.3** 


5.2** 


7.0** 


4.9** 


2.1 



Recertified same month 
or 1 month before 
review 

Recertified 2-3 months 



before review 


4.7** 


3.1** 


1.5** 


2.3** 


1.5* 


0.8* 


Recertified 4-6 months 














before review 


7.6** 


5.2** 


2.4** 


4.1*- 


2.8** 


1.2** 


Recertified more than 7 














months before review 


5.9** 


4.9** 


1.0 


6.6** 


6.1** 


0.5 


R2 


4.4 


4.1 


1.8 


2.4 


2.5 


1.0 


F-ratio 


62.0 


57.4 


24.5 


29.8 


31.0 


11.7 


Percent of cases in error 


17.6 


12.8 


4.9 


16.0 


12.1 


3.9 



•Significant at the 51 level. 
"Significant at the 15 level. 
Note: Estimated standard errors are presented in Table B-4. 
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The numbers presented in these tables are the coefficients in the 
regression model discussed above.* For the continuous variables in the 
model (household size, Food Stamp allotment, and the length of certification 
period), these coefficients can be interpreted as the amount the average 
error increases when these variables increase by one unit. For example, 
Table IV-1 indicates that for NPA cases the average amount of all errors to 
households with three members is $1.91 higher than the average amount of 
errors to households with two members. That is, for every additional 
household member, the average amount of error increases by $1.91 for NPA 
cases. The remaining variables are categorical and the coefficients can be 
interpreted as the difference in the average amount of error for households 
in the category compared to households outside of the category after 
controlling for the effects of all other case characteristics in the model. 
Thus, Table IV-1 indicates that among NPA cases the average error is $0.62 
greater among households containing an alien than among households that do 
not contain an alien (this result is not statistically significant). 
Similarly, the coefficient of the variable indicating that the race of the 
household head is black indicates that the average amount of overpayment 
error is $1.53 greater for black households than for white households (the 
omitted category). 

These tables reveal that the relationships between the case 
characteristics and errors have several general patterns: 

. Characteristics have similar effects on errors for both NPA cases 
and for PA cases. However, the magnitude of the effect tends to be 
larger for PA cases. 

. Characteristics that increase the amount of overpayments also tend 
to increase the amount of underpayments. Thus, most characteristics 
appear to be indicators of error, and much of the overpayments to a 
group of people are offset by underpayments to people in the same 
group. For example, while large households tend to have larger 
overpayments, they also have larger underpayments that more than 
offset the larger overpayments. 



* 



Estimated standard errors of the coefficients presented in these tables 
are presented in Appendix B. 
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. Characteristics that affect overi ssuances to eligibles either affect 
payments to ineligibles in the same direction or not at all. Thus, 
if a characteristic increases overi ssueances to eligibles, it either 
increases or has no effect of payments to ineligibles. This result 
is to be expected because, for a given case, an overissuance to an 
eligible would become a payment to an ineligible if the amount of 
error became larger than the Food Stamp allotment. 

. Most characteristics affect the amount of error and the incidence of 
error in a similar manner. 

Exceptions to these general patterns are highlighted in our discussion of 
the relationship between errors and specific characteristics below. 

Contrary to expectations, the demographic characteristics often have a 
statistically significant relationship to error. The number of household 
members tends to increase errors, both underpayments and overpayments. 
However, it is the only variable that increases payments to ineligibles 
while decreasing overi ssuances to eligibles. This result may arise because 
small errors in household size cause relatively large errors in the 
allotment. Whether an alien is present in the household has little 
relationship with either the amount or incidence of error. Households with 
a nonwhite household head tend to have more overpayments and underpayments 
than do households with a white head of household. However, there is little 
difference in payments to ineligibles between whites and nonwhites. 

The presence of the various types of income (except SSI) increases both 
overpayments and underpayments. Most of the increase in overpayments 
results from overi ssuances to eligibles rather than payments to 
ineligibles. Further, the effect on errors of having earnings (either less 
than $500 or more than $500) is substantially greater for PA cases than for 
NPA cases. In contrast, for NPA cases, the presence of SSI seems to be an 
indicator of cases with lower overpayment errors. This is consistent with a 
common understanding among FSP staff that such households are quite stable 
and subject to few errors. 

The presence of a shelter deduction is another important indicator of 

overpayment errors among NPA cases. Whether the household has net income 

appears to be related to the presence of error in PA households, but not in 
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NPA households. The presence of liquid resources is negatively associated 
with overpayment errors for NPA cases and with underpayment errors for both 
NPA and PA cases. One possible explanation of this unexpected result is 
that households who reveal liquid resources (an easily-concealed item) to 
the agency, are likely to be reporting other items accurately. 

The amount of the Food Stamp allotment itself is strongly associated 
with the presence of errors. However, much of this effect is "mechanical". 
For example, the allotment amount is positively associated with overpayments 
and negatively associated with underpayments. This may result from the fact 
that the over- or underpayment is incorporated in the Food Stamp amount, 
thus inducing a spurious correlation, and from the fact that households with 
small allotments cannot receive large overpayments. Because of the 
mechanical nature of this relationship between the allotment and the error 
amount, we also estimated models in which the dependent variable was the 
ratio of the error to the Food Stamp allotment. The results of these models 
were generally similar to the results presented here except for the impact 
of the Food Stamp allotment, which tended to be small. One anomaly in the 
relationship between the allotment amount and errors is that the allotment 
amount increases the average amount of payment error to ineligibles while 
decreasing the incidence of payments to ineligibles. This result probably 
occurs because, while cases with large allotments have fewer eligibility 
errors, eligibility errors that do occur are large (because the error equals 
the allotment). 

As expected, the length of the certification period is negatively 
related to overpayments for PA cases. Thus, the local agencies appear to be 
assigning longer certification periods to PA cases that are less susceptible 
to error. However, the average overpayment differs by only 6Q£ between 
cases certified for 6 months and cases certified for 3 months. This 
relationship does not, however, hold for NPA cases. Indeed, the incidence 
of errors is positively associated with the length of the certification 
period for NPA cases. 
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As expected, errors are substantially more likely several months after 
certification or recertification than in the month of re/certification or 
the month after re/certification. This is true for both kinds of cases and 
all kinds of errors. The increase in the average error several months after 
certification or recertification appears to be larger for cases whose most 
recent action was initial certification than for those that were recertified. 
One possible explanation for this result is that changes in circumstances 
are more likely for new cases than for cases that have been eligible long 
enough to be recertified. Thus, it might be desirable to assign shorter 
certification periods to new cases than to ongoing cases. In the month of- 
certification or recertification, however, there is little difference between 
new cases and ongoing cases in both the amount and incidence of error. 

While the estimated models contain a large number of variables with 
significant effects on error, and the equations as a whole are strongly 
significant,* these models explain only a small portion of the variance of 
errors among individuals. Indeed, no equation explains even 10% of the 
variance of the error amounts. Further, the models explain more of the 
variance of total errors and overpayment errors than of underpayment errors 
and explain more of the variance of overissuances to eligibles than of 
payments to ineli.gibles. The latter result is probably due to the fact that 
payments to ineligibles include only large errors. 

Based on these results, it seems unlikely that variations in case 
characteristics among states will explain much of the known variation in 
error rates among states. To assess this latter hypothesis, we estimated 
some additional models in which we included dummy variables for the states 
both alone and in combination with case characteristics. The case character- 
istics in these models included only those characteristics over which the 



The F-test of the null hypothesis that all coefficients except the 
intercept are zero is presented in the tables and is always strongly 
significant. 
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local and state agencies have no control. The models incorporating only the 
binary variable for states explain approximately 1% of the variance of over- 
payment errors and total errors among individuals. Only a small portion of 
this variation in error due to states is explained by differences in client 
characteristics among states. Our results indicate that variation in demographic 
characteristics among states accounts for only 30% of the variance in errors 
due to states for NPA cases and less than 10% for PA cases. Thus, the bulk 
of the variance among states in error rates does not result from the case 
characteristics examined in this study. In subsequent analysis, we will 
examine whether the remaining variation in errors can be explained by differences 
in the certification and recer-tifi cation procedures used by the states. 



* 
Thus we excluded the length of the certification period and the dummy 

variables for the various lengths of time since certification and 

recertification. However, the proportion of cases certified in the month 

or the month before the QC review (i.e., new cases) was kept in the model. 

** 
These figures are based on the following calculation. First, we calculated 
the proportion of variance explained in the model that included both 
demographic characteristics and the dummy variables for states, 

2 

R n <-; the proportion of variance explained by demographic characteristics 

2 

alone, R D ; and the proportion of variance explained by the dummy variables 

2 
for states alone, R<. . We then calculated the proportion of variance 

explained by state after controlling for demographic characteristics by 

R SID = R CS " R C ' We then calculated tne ratio of R s!D t0 R S ' whicn 

represents the proportion of the variation due to states that remain after 
controlling for demographic characteristics. This ratio exceeded .7 for 
the NPA models and .9 for the PA models. 
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in the case, then both an earned income and calculation error were recorded 
in the QC data. 

To overcome this problem with the proportional model, we estimated an 
alternative model that separated the impact of the first error recorded from 
the impact of subsequent errors.* Specifically, we included binary 
variables for whether the first error listed was of a specific type as well 
as additional variables for the number of subsequent errors of specific 
types that occurred in each case. 

As an example of how the results of this model can be used to attribute 
dollar error to each source, we present the results for total error for NPA 
cases in Table V-l . The first column presents the estimated amount of error 
for each source when that is the first error listed. The second column 
presents the estimated amount of error for subsequent errors. These results 
support the hypothesis that the $5 minimum error results in the proportional 
model being inappropriate. The estimated size of subsequent errors for most 
sources are small and generally near $5.** If these errors had been the 
only error in the case, the case would not have been counted in error. 
There are two exceptions: subsequent earned income errors, and particularly 
subsequent household size errors, represent substantial amounts of benefits 
paid in error. We investigated whether the size of these two subsequent 
errors was influenced by the source of the first error and found that there 
were no significant interactions. 

From the estimated size of first and subsequent errors, we have 
calculated the amou.it of the total error that can be attributed to each 



* 
In our survey of state QC directors, we found that in all but 2 of 38 

states, the first error recorded is the most important in a case. The 

model we estimated, however, does not make any assumptions about the 

ordering of the errors. 

*• 
The estimated impact of subsequent deductions is a small negative number 
that is not significantly different from zero. It should be interpreted 
as essentially zero. 
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Table V-l 
ESTIMATED IMPACT OF FIRST ANO SUBSEQUENT ERRORS ON TOTAL ERROR RY SOURCE OF ERROR— NPA CASES 









Percent of 












Errors of 


Estimated 


Percent of 






Estimated 


Sped fled 


Average 


All Variances 




Estimated 


Amount of 


Type that 


Amount of 


Due to 




Amount of 


Subsequent 


are First 


Error When 


Specified 


Source of Error 


First Error 

$50.00** 


Error 


Errors 


Error Present 
$41.04 


Source 


Earned Income 


$12.81** 


75.9% 


26.0% 




(0.81) 


(1.25) 








Unearned Income 


34.02** 
(0.96) 


3.62** 
(0.92) 


53.4 


19.85 


24.7 


Resources 

< 
i 


62.92** 
(1.61) 


5.90** 
(0.97) 


33.4 


24.95 


13.5 


Deductions 


18.33** 
(1.11) 


-0.97 
(0.73) 


34.1 


5.61 


26.7 


Household slie 


51.27** 
(1.62) 


29.83** 
(2.78) 


77.2 


46.38 


5.8 


Other nonflnanclal 


80.75** 
(3.79) 


0.84 
(4.76) 


61.3 


49.83 • 


1.2 


Computations 


32.57** 
(3.38) 


6.41* 
(2.91) 


43.4 


17.76 


2.1 



Estimated Total Estimated Percent 

Dollar Error of Total Dollar 

Due to Error Due to 

Specified Source Specified Source 



$10.65 
4.90 
3.37 
1.50 
2.6R 
0.61 
0.37 



44.2% 

20.3 

14.0 

6.2 

11.1 

2.5 

1.6 



Total 



100% 



24.08 



100% 



'Significant at the 5% level. 
"Significant at the 1% level. 
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V DOLLAR VALUE BY SOURCE, CAUSE, AND TIMING OF ERRORS 



In developing appropriate corrective actions, it is useful to know what 
proportion of the total amount of error can be attributed to various causes, 
so that policymakers can target corrective actions to the most costly 
errors. Currently, the Food Stamp QC data do not attribute the dollar 
amount of error to specify kinds of errors when there is more than one error 
in a case. If, for example, both a household size error and an earned 
income error are made, the QC reviewer does not record the separate dollar 
impact of each error, but rather records the total dollar impact and the 
fact that both errors were made. Even if the reviewers were required to 
calculate the separate dollar impacts, the procedures to allocate dollar 
error to each source would be arbitrary. It is not clear, for example, 
whether the size of the household error should be calculated assuming the 
correct income amounts or whether the size of the earned income error should 
be calculated assuming the correct household size when both types of errors 
are present. 

Because of these data limitations, the Food Stamp Quality Control 
Reports include only the incidence of error by various sources and by 
whether the errors were agency- or client-caused. Although it is useful to 
know which errors occur most frequently, focusing only on the incidence of 
errors may be misleading if the dollar impacts of errors vary greatly. 

In this section, we develop a statistical methodology to estimate the 
contribution of various error types to the total dollar amount of error. By 
examining how the incidence of various errors is related to dollar errors 
over a large sample of QC cases, we can estimate the independent effect of 
each error source on dollar error, while controlling for other types of 
errors that may also be present in the case. In the next subsection we 
describe the data and the statistical model that we use to estimate the 
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relationships between source and dollar amount of error. We then present 
the estimated dollar amounts by source of error, by whether the error was 
client- or agency-caused, and by whether the error was present before the 
most recent certification. We also examine whether the impact of the source 
of error differs by whether the error was agency- or client-caused. 



Statistical Models to Estimate the Dollar Amount of Error by Type 

In estimating the dollar error that is attributable to each source of 
error, we have used multiple regressions to isolate the independent impact 
of each source of error. The samples for these regressions include all 
cases with errors, and the dependent variables are the dollar amounts of 
error. The independent variables represent the number of errors from each 
specific source which occurred in each case. The coefficients of these 
independent variables represent the average dollar error that is associated 
with an error of each type, controlling for all other types of error that 
may also have occurred. 

We estimated several models using alternative specifications of the 
independent variables. The simplest model is a proportional model that 
includes variables for the number of each type of error that occurred in a 
case. This model implies that each error has an additive and independent 
effect on the amount of error. When we estimated this model, however, we 
determined that it was not an appropriate specification because of the 
presence of a large and significant intercept in the equation. This 
intercept implies that the size of the error was independent of the number 
of errors in a case. 

This result could occur because of a threshold on the amount of error 
that is imposed by QC regulations. A case is not counted as being in error 
unless the amount of error is greater than $5. Once a case is found to be 
in error, however, all sources of error are recorded. Thus, for example, a 
small calculation error of $2 would not create a QC error if no other 
mistakes were found. If, however, there were also a $50 earned income error 
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source. The third column of Table V-l presents the percent of errors that 
are first errors for each source. From this we can weight the size of the 
first and subsequent errors to obtain the average amount of error for each 
source, which is presented in the fourth column. The fifth column presents 
the proportion of all errors that are due to each source. The amount of the 
average error multiplied by the proportion of errors due to each source 
represents the dollar amount of the average error that can be attributed to 
each source, presented in the sixth column. The seventh column presents the 
percent of dollar error that can be attributed to each source. 

In the next subsection, we present tables that contain for each source 
the average amount of error when an error is present, the percent of the 
errors that are due to that source, and the percent of the dollar error that 
can be attributed to each source. These numbers can be calculated from the 
results presented in Appendix Tables C-l through C-10, which contain-the 
estimated size of first and subsequent error and the proportion of first 
errors. 



Sources of Error 

Based on the methodology described above, we have estimated the amount 
of overpayment error (to both eligibles and ineligibles) and of total error 
that can be attributed to various sources of error for NPA and PA cases 
(Tables V-2 and V-3). These results emphasize the importance of earned 
income errors. Among NPA cases, 26. IS of the overpayment errors are earned 
income errors, but because of the relatively large size of these errors 
($44), earned income errors account for 44.4% of the dollar amount of NPA 
overpayments. Thus, the importance of earned income errors is even greater 
than would be suggested by simply examining the incidence of errors. In 
contrast, errors in deductions account for 24.4% of NPA overpayment errors, 
but because the average size of such errors is less than $5, errors in 
deductions account for only 4.2% of the dollar amount of NPA overpayments. 
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Table V-2 
ESTIMATED AMOUNT OF OVERPAYMENT ERROR ATTRIBUTABLE TO VARIOUS SOURCES OF ERROR 



NPA Error Cases (n=7,428) 



PA Error Cases (n=5,451 ) 



i 

en 



Source of Error 


Estimated 
Average 
Amount of 
Error When 
Error Present 

$44.47 


Percent of 
Overpayment 
Variances 
Due to 
Specified 
Source 

26. IX 


Estimated 
Percent of 

Dollar 
Overpayment 
Error Due to 
Specified Source 

44. 4% 


Estimated 
Average 
Amount of 
Error When 
Error Present 

$57.84 


Percent of 

Overpayment 

Variances 

Due to 

Specified 

Source 

24.5% 


Estimated 
Percent of 

Dollar 
Overpayment 
Error Due to 
Specified Source 


Earned income 


43.0% 


Unearned income 


21.00 


'26.4 


21.2 


24.18 


26.2 


19.3 


Resources 


29.14 


15.1 


16.8 


32.92 


8.0 


8.0 


Deductions 


4.47 


24.4 


4.2 


6.18 


26.6 


5.0 


Household size 


46.88 


5.0 


9.0 


61.24 


10.6 


19.8 


Other nonfinancial 


57.46 


1.4 


3.1 


67.13 


1.7 


3.4 


Computations 


19.03 


1.7 


1.4 


20.94 


2.4 


1.5 



Total 



100% 



100% 



100% 



100% 
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Table V-3 
ESTIMATED AMOUNT OF TOTAL ERROR ATTRIBUTABLE TO VARIOUS SOURCES OF ERROR 



NPA Error Cases (n=10,232) 



PA Error Cases (n=8,100) 





Source of Error 


Estimated 
Average 
Amount of 
Error When 
Error Present 

$41.04 


Percent of 

All 

Variances 

Due to 

Specified 

Source 

26.0% 


Estimated 

Percent of 

Total Dollar 

Error Due to 

Specified Source 

44. 2% 


Estimated 

Average 

Amount of 

Error When 

Error Present 

$51.46 


Percent of 

All 

Variances 

Due to 

Specified 

Source 

21. 8% 


Estimated 

Percent of 

Total Dollar 

Error Due to 

Specified Source 

38. 9% 


< 


Earned Income 


1 

-J 


Unearned Income 


19.85 


24.7 


20.3 


22.22 


24.3 


18.7 




Resources 


24.95 


13.5 


14.0 


26.38 


7.1 


6.5 




Deductions 


5.61 


26.7 


6.2 


7.52 


30.9 


8.1 




Household size 


46.38 


5.8 


11.1 


57.63 


11.6 


23.3 




Other nonfinancial 


49.83 


1.2 


2.5 


56.45 


1.4 


2.7 




Computations 


17.76 


2.1 


1.6 


17.05 


2.9 


1.7 



Total 



100% 



100% 



100% 



100% 
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Errors in unearned income result in 21.2% and errors in resources 
result in 16.8% of the dollar amount of NPA overpayments. Errors in 
household size and nonfinancial errors are both relatively large when they 
occur (the latter are large primarily because they result in eligibility 
errors). Because these errors are infrequent, however, they account for a 
relatively small percent of NPA dollar errors (9.0% and 3.1% respectively). 
Errors in computing net income or the Food Stamp allotment are relatively 
small and infrequent and thus account for only 1.4% of the dollar amount of 
NPA overpayment errors. 

The pattern of results for PA cases is generally similar. Earned 
income errors are also very important for PA cases, accounting for 43% of 
the dollar amount of PA overpayment errors. Unearned income errors are also 
important, accounting for 19.3% of dollar overpayment error. There are, 
however, some differences between NPA and PA cases. Resource errors are 
less frequent for PA cases, perhaps because PA cases are more disadvantaged 
and have fewer resources to report. On the other hand, household size 
errors are more frequent for PA cases, partly because the households are 
larger and perhaps also because of the differences in the definition of the 
recipient unit between AFDC and Food Stamp regulations. 

Table Y-3 presents the results for total error for NPA and PA cases. 
These results are very similar to those for overpayments. Specifically, the 
importance of earned income error is again emphasized: 44.2% of the total 
amount of NPA error and 38.9% of the total amount of PA error is 
attributable to earned income errors. 



Cause of Error 

Table V-4 contains the estimated amount of overpayment error 
attributable to causes of error. We present the estimated amount of 
overpayment error attributable to all agency errors combined and all client 
errors combined, and also the amount attributable to specific types of 
agency and client errors. For NPA cases, 74.4% of the dollar amount of 
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Table V-4 
ESTIMATED AMOUNT OF OVERPAYMENT ERROR ATTRIBUTABLE TO VARIOUS CAUSES OF ERROR 



NPA Error Cases (n=7,428) 



PA Error Cases (n=5,451 ) 



Cause of Error 

Client-caused 

Information not 
reported 

Information 
incompletely 
reported 

Other client error 



Agency -caused 

Policy incorrectly 
appl ied 

Failed to follow 
up on information 
provided 

Arithmetic error 

Other agency error 



Estimated 

Average 

Amount of 

Error When 

Error Present 

$31.72 



36.35 

26.29 
28.79 

17.06 

15.13 

20.55 
10.13 
13.51 



Percent of 

Overpayment 

Variances 

Due to 

Specified 

Cause 

61. 0* 



32.7 

27.6 
0.8 

39.0 

13.8 

18.9 
4.7 
1.6 



Estimated 
Percent of 

Dollar 
Overpayment 
Error Due to 
Specified Cause 

74.4% 



45.7 

27.9 
0.9 

25.6 

8.0 

14.9 
1.8 
0.9 



Estimated 
Average 
Amount of 
Error When 
Error Present 

$40.55 



46.32 



Percent of 

Overpayment 

Variances 

Due to 

Specified 

Cause 

55.2 



35.2 



Estimated 
Percent of 

Dollar 
Overpayment 
Error Due to 
Specified Cause 

68.7 



30.0 



30.42 


19.3 


18.0 


33.00 


0.7 


0.8 


22.80 


44.8 


31.3 


21.48 


13.2 


8.7 


24.47 


25.6 


19.2 


15.19 


3.9 


1.8 


24.58 


2.0 


1.5 
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overpayments can be attributed to client-caused error. This is a result 
both of client-caused error occurring more frequently (61* versus 39*), and 
of client-caused error being almost twice as large as agency-caused error 
($32 versus $17). The client not reporting information is the largest 
contributor to client-caused overpayment error. Among agency-caused error, 
not following up appropriately on information provided is the largest 
contributor to overpayment error. 

For PA cases, the amount of overpayments attributable to agency-caused 
error is higher, perhaps due to the more complex nature of PA cases. 
Nonetheless, the amount of overpayments that can be attributed to clients 
not reporting information is higher for PA than for NPA cases, accounting 
for 50% of overpayments to PA households. 

Table V-5 presents the results for total error, including both 
overpayments and underpayments. Because a greater proportion of 
underpayment error than overpayment error is agency-caused, the amount of 
agency-caused total error is greater than for overpayment error. Much of 
this increase in agency-caused error is accounted for by the increase in the 
amount of error resulting from the agency not correctly following up on 
information provided by the client. 



Source of Error by Cause of Error 

The results of the previous subsections indicate that earned income is 
an important source of error and that client-caused errors account for a 
majority of dollar error. In this subsection we examine the source of error 
by cause of error. We do this by expanding our estimation models to include 
separate variables for the number of each source of error that are 
client-caused and the number that are agency-caused. The results for 
overpayments to NPA cases are presented in Table V-6 and to PA cases in 
Table V-7. 
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Table V-5 
ESTIMATED AMOUNT OF TOTAL ERROR ATTRIBUTABLE TO VARIOUS CAUSES OF ERROR 



NPA Error Cases (n=10,232) 



PA Error Cases (n=8,100) 



Cause of Error 

Client caused 

Information not 
reported 

Information 
Incompletely 
reported 

Other client error 



Agency caused 

Policy incorrectly 
applied 

Failed to follow 
up on information 
provided 

Arithmetic error 

Other agency error 



Estimated 

Average 

Amount of 

Error When 

Error Present 

$29.29 



34.63 

22.91 
26.00 

16.52 

14.74 

19.97 
10.21 
13.85 



Percent of 

All 
Variances 
Due to 
Specified 
Cause 

58.7% 
31.7 

26.3 
0.7 

41.3 

15.1 

19.2 
5.1 

1.8 



Estimated 

Percent of 

Total Dollar 

Error Due to 

Specified Cause 

71.6% 



45.7 

25.1 
0.8 

28.4 

9.3 

16.0 
2.2 
1.1 



Estimated 

Average 

Amount of 

Error When 

Error Present 

35.94 



41.27 



Percent of 
All 
Variances 
Due to 
Specified 
Cause 

50.6 



32.3 



Estimated 

Percent of 

Total Dollar 

Error Due to 

Specified Cause 



63.7 



46.6 



26.54 


17.6 


16.3 


29.62 


0.8 


0.8 


20.94 


49.4 


36.3 


19.75 


14.8 


10.2 


22.55 


27.7 


21.9 


14.13 


4.5 


2.2 


23.13 


2.2 


1.8 
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Table V-6 
ESTIMATED AMOUNT OF OVERPAYMENT ERROR ATTRIBUTABLE TO VARIOUS SOURCES OF ERROR BY CAUSE OF ERROR— NPA CASES 



Cl ient-Caused Error 



Agency-Caused Error 



Source of Error 
Earned income 
Unearned Income 
Resources 
Deductions 
Household size 
Other nonfinancial 
Computation 



Estimated 
Average 
Amount of 
Error When 
Error Present 


Percent of 

Overpayment 

Variances 

Due to 

Specified 

Source 


Estimated 
Percent of 

Dollar 
Overpayment 
Error Due to 
Specified Source 


Estimated 

Average 

Amount of 

Error When 

Error Present 


Percent of 
Overpayment 
Variances 
Due to 
Specified 
Source 


Estimated 
Percent of 

Dollar 
Overpayment 
Error Due to 
Specified Source 


$49.65 


18.1* 


34.4* 


$32.47 


8.0* 


9.9* 


26.40 


13.7 


13.8 


15.41 


12.7 


7.5 


32.04 


12.2 


14.9 


14.50 


2.9 


1.6 


4.75 


12.6 


2.3 


5.25 


11.7 


2.4 


48.74 


3.5 


6.6 


38.88 


1.5 


2.2 


53.51 


0.8 


1.7 


62.36 


0.5 


1.2 


-- 


— 


— 


20.03 


1.9 


1.4 
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Table V-7 
ESTIMATED AMOUNT OF OVERPAYMENT ERROR ATTRIBUTABLE TO VARIOUS SOURCES OF ERROR BY CAUSE OF ERROR-PA CASES 



Client-Caused Error 



Agency-Caused Error 



Source of Error 


Estimated 
Average 
Amount of 
Error When 
Error Present 

$66.14 


Percent of 

Overpayment 

Variances 

Due to 

Specified 

Source 

16.5% 


Estimated 
Percent of 

Dollar 
Overpayment 
Error Due to 
Specified Source 

33.1% 


Estimated 

Average 

Amount of 

Error When 

Error Present 

$40.29 


Percent of 
Overpayment 
Variances 
Due to 
Specified 
Source 

8.0% 


Estimated 
Percent of 

Dollar 
Overpayment 
Error Due to 
Specified Source 


Earned income 


9.8% 


Unearned income 


31.75 


11.7 


11.2 


18.29 


14.6 


8.4 


Resources 


33.80 


6.5 


6.7 


24.04 


1.5 


1.1 


Deductions 


6.31 


12.9 


2.5 


6.56 


13.7 


2.7 


Household size 


66.72 


6.6 


13.4 


50.51 


4.0 


6.2 


Other nonfinancial 


66.80 


1.0 


2.0 


64.29 


0.7 


1.3 


Computation 


__ 


«.- 


— 


22.01 


2.4 


1.6 
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Client-caused errors in earned income are by far the largest single 
cause of overpayment of Food Stamp benefits. Over 34* of the dollar amount 
of NPA overpayment errors result from client-caused errors in earned income; 
similarly, 33* of the dollar amount of PA overpayment errors are due to such 
errors. These results indicate that techniques such as wage matching and 
monthly reporting of earned income are aimed at the most important source of 
error. An important component of the remainder of our study will be to 
determine whether such techniques are cost-effective. 

Approximately equal proportions of unearned income errors are client- 
and agency-caused. The size of client-caused errors in unearned income are 
considerably larger, however, so that the proportion of dollar error 
attributable to clients is greater than that attributable to agencies. 
Nonetheless, unearned income errors account for a substantial amount of 
agency-caused overpayment error. 

As noted above, resource errors are a more important source of error 
for NPA cases than for PA cases. The results in Table V-6 indicate that 
most of these errors are client-caused: 14.9* of the dollar amount of NPA 
overpayments are due to client-caused resource errors, while only 1.6* is 
due to agency-caused resource errors. 

Tables V-8 and V-9 present the results for total error for NPA and PA 
cases respectively. The pattern is similar to that for overpayment error. 



Timing of Error 

Tables V-10 and V-ll presents the amount of overpayment and total error 
that can be attributed to errors that occurred before the most recent 
certification and to errors that occurred afterward. Among NPA cases, 
approximately 60% of dollar error is due to mistakes present in the case at 
the most recent certification; among PA cases, the percent is somewhat lower 
(55*). In all cases, however, the size of errors that occur after the most 
recent certification is larger, averaging between $9 more for NPA total 
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Table V-8 
ESTIMATED AMOUNT OF TOTAL ERROR ATTRIBUTABLE TO VARIOUS SOURCES OF ERROR BY CAUSE OF ERROR--NPA CASES 



Client-Caused Error 



•< 
1 


Source of Error 


Estimated 

Average 

Amount of 

Error When 

Error Present 


Percent of 

All 
Variances 
Due to 
Specified 
Source 


Estimated 

Percent of 

Total Dollar 

Error Due to 

Specified Source 


Estimated 

Average 

Amount of 

Error When 

Error Present 


Percent of 

All 
Variances 
Due to 
Specified 
Source 


Estimated 

Percent of 

Total Dollar 

Error Due to 

Specified Source 


<_n 


Earned Income 


$46.74 


17.2 


33.4 


$29.66 


8.8 


10.8 




Unearned income 


24.81 


12.4 


12.8 


14.97 


12.3 


7.6 




Resources 


27.94 


10.8 


12.5 


11.30 


2.8 


1.3 




Deductions 


5.38 


13.4 


3.0 


6.58 


13.3 


3.6 




Household size 


47.25 


4.1 


7.9 


41.72 


1.7 


3.0 




Other nonfinancial 


46.92 


0.8 


1.5 


53.59 


0.5 


1.0 




Computation 


-- 


— 


— 


18.70 


2.1 


1.6 
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Table V-9 
ESTIMATED AMOUNT OF TOTAL ERROR ATTRIBUTABLE TO VARIOUS SOURCES OF ERROR BY CAUSE OF ERROR— PA CASES 



CI ient-Caused Error 



i 



Source of Error 
Earned income 
Unearned income 
Resources 
Deductions 
Household size 
Other nonfTnancial 
Computation 





Percent of 




Estimated 


All 


Estimated 


Average 


Variances 


Percent of 


Amount of 


Due to 


Total Dollar 


Error When 


Specified 


Error Due to 


Error Present 


Source 


Specified Source 


$59.89 


13.8 


28.6 


29.89 


9.6 


10.0 


27.64 


5.6 


5.4 


6.95 


13.6 


3.3 


61.02 


7.0 


14.9 


57.19 


0.8 


1.6 



Agency-Caused Error 





Percent of 




Estimated 


All 


Estimated 


Average 


Variances 


Percent of 


Amount of 


Due to 


Total Dollar 


Error When 


Specified 


Error Due to 


Error Present 


Source 


Specified Source 


$36.87 


8.1 


10.3 


17.69 


14.7 


9.0 


16.11 


1.5 


0.8 


8.46 


17.4 


5.1 


50.98 


4.6 


8.1 


52.89 


0.6 


1.1 


17.69 


2.8 


1.7 
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Table V-10 
ESTIMATED AMOUNT OF OVERPAYMENT ERROR ATTRIBUTABLE TO BEFORE AND AFTER MOST RECENT CERTIFICATION 



NPA Error Cases (n=7,428) 



PA Error Cases (n=5,451 ) 



Timing of Error 

At or before most 
recent certifi- 
cation 

After most recent 
certi fication 



Estimated 
Average 
Amount of 
Error When 
Error Present 



$23.78 



Percent of 

Overpayment 

Variances 

Due to 

Specified 

Time 



68.7% 



Estimated 
Percent of 

Dollar 
Overpayment 
Error Due to 
Specified Time 



62.8% 



Estimated 
Average 
Amount of 
Error When 
Error Present 



$30.02 



Percent of 

Overpayment 

Variances 

Due to 

Specified 

Time 



61.1% 



Estimated 
Percent of 

Dollar 
Overpayment 
Error Due to 
Specified Time 



56.0% 



31.15 



31.3 



37.2 



37.02 



38.9 



44.0 



Total 



100% 



100% 



100% 
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Table V-ll 
ESTIMATED AMOUNT OF TOTAL ERROR ATTRIBUTABLE TO BEFORE AND AFTER MOST RECENT CERTIFICATION 



NPA Error Cases (n=l 0,232) 



PA Error Cases (n=8,100) 







Percent of 






Percent of 






Estimated 


All 


Estimated 


Estimated 


All 


Estimated 




Average 


Variances 


Percent of 


Average 


Variances 


Percent of 




Amount of 


Due to 


Total Dollar 


Amount of 


Due to 


Total Dollar 




Error When 


Specified 


Error Due to 


Error When 


Specified 


Error Due to 


Timing of Error 


Error Present 


Cause 


Specified Cause 


Error Present 


Cause 


Specified Cause 


At or before most 




recent certifi- 














cation 


$21.25 


68.4* 


60.31 


$26.41 


60.0% 


55.3% 


After most recent 














certi fication 


30.23 


31.6 


39.7 


31. 9e 


40.0 


44.7 



Total 



100% 



100% 



100% 



100% 
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errors to $5.57 more for PA total errors. These results suggest, therefore, 
that monthly reporting and other techniques for monitoring clients 
circumstances between certifications may be potentially important in 
reducing dollar error. 



Summary and Conclusions 

In this section, we have developed a methodology for estimating the 
amount of error that is attributable to various sources, causes and timing 
of error. The 'results indicate that errors in earned income are even more 
important than their frequency would suggest. For example, among NPA cases, 
26% of overpayment errors occur in earned income, but because the size of 
such errors is large, earned income errors account for over 44% of the 
dollar amount of overpayments. The results for the impact of causes of 
error indicate that over 70% of the dollar value of overpayments can be 
attributed to client-caused errors. When we examine the sources of error by 
cause of error, we find that approximately one-third of dollar overpayments 
can be attributed to client-caused earned income errors. With respect to 
the timing of errors, the results indicate that errors that occurred after 
the most recent certification are larger than those that occurred before the 
most recent certification. 

The results of this analysis highlight the importance of specific types 
of error. In our subsequent analysis, we will pay particularly close 
attention to the cost-effectiveness of procedures that are designed to 
reduce those errors that make large contributions to the total amount of 
Food Stamp benefits that are paid in error. 
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VI SUMMARY 

This report examined the kinds, sources, and causes of errors present in Food Stamp 
cases. The report also described the kinds of households represented, investigated the 
relationship between household characteristics and error patterns, and attributed the 
dollars in error to various types of error. 

The report was based on data from the Food Stamp Program Quality Control (QC) system 
and analyzed nearly 75,000 QC cases drawn from forty states plus the District of 
Columbia. This was the largest, most complete sample of QC cases available when the 
analyses were conducted. Most cases were from April 1981 through March 1982, the 
most recent period for which data were available for the bulk of the states. When data 
from that period were unavailable, data from October 1980 through September 1981 were 
used. Below we highlight the main findings of these analyses. 

Error Patterns 

o Overall, about one-fourth of the cases contained an error. Many errors were 
minor and the dollar overpayment rate was 8.7 percent. The most prevalent 
kind of error was overissuance to eligibles (about 13 percent of cases), followed 
by underpayments to eligibles (about 7 percent) and payments to ineligibles 
(about 5 percent). 

o Among cases with errors, the average overpayment was about $53, consisting of 
payments to ineligibles (averaging about $93) and overissuances to eligibles 
(about $38). Underpayments averaged about $33. 

o Mistakes related to the amoy/it of the household's earned income were the 
largest source of first errors (about one-third of cases), followed by mistakes 
related to unearned income (about 24 percent) and deductions (about 20 
percent). 



* 



A case may contain several errors (for example, the client underreported income and 
the caseworker also miscalculated the shelter deduction). The report analyzed the first 
error recorded for each case for two reasons: (i) they are almost always the most 
important and (ii) the appropriate weight for subsequent errors is unclear because the 
dollar amount of error is not partitioned among multiple error sources by QC reviewers. 
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o The majority of first errors (about 58 percent of cases) were client-caused, due 
largely to failure to report information. About 42 percent were agency-caused, 
due largely to failure to take action on reported information. 

o Public Assistance (PA) and Nonpublic Assistance (NPA) cases had different error 
patterns. Compared to NPA cases, PA cases: 

contained slightly fewer overpayment errors (16.0 percent vs. 18.5 
percent) Igyt marginally more underpayment errors (7.8 percent vs. 7.0 
percent); 

involved somewhat larger average overpayment amounts ($57.31 vs. 
$50.58), although there was no difference in underpayment amounts; 

were less likely to contain errors related to income or resources (56 
percent of first errors vs. 71 percent), but more likely to contain errors 
related to deductions and household size (40 percent vs. 26 percent); and 

were more likely to involve agency-caused errors (48 percent vs. 38 
percent). 

Household and Case Characteristics 

o Sample households averaged about 2.8 persons; about half had white heads of 
household, about 38 percent were black, and 9 percent were Hispanic. About 
one in five households had earned income, about 46 percent received public 
assistance or general assistance, 27 percent received social security or pensions, 
and about one-fourth reported liquid assets. 

o The average Food Stamp allotment was about $107. The average certification 
period was seven months. About 5 percent of the sample cases received 
expedited services in the review period. 

o PA households were larger, less likely to earn income or receive Social Security 
benefits, and more likely to have a nonwhite head of household than NPA 
households. PA households received larger allotments (due to larger household 
size and lower income) and slightly longer certification periods than NPA 
households, but were less likely to receive expedited services. 

Relating Household and Case Characteristics to Errors 

Household and case characteristics explained only a small portion of errors. The study 
analyzed the combined explanatory effect of household and case characteristics on 
several measures of error, including both the dollar amount and incidence of 



Although small, these differences— like the others reported here— are statistically 
significant. 
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overpayment, underpayment and total errors. When combined, household and case 
characteristics never explained more than 9 percent of the variance of errors among 
individuals and usually explained only 3 percent of the variance. 



Although the combined explanatory power of household and case characteristics 
was quite weak, some characteristics nonetheless show a statistically significant 
relationship to error. These are described below. 

Households with more members had more overpayments and 
underpayments than households with fewer members. 

Households with a nonwhite head had more underpayments and more 
overissuances to eligibles than households with a white head (but there was 
little difference between whites and nonwhites in payments to ineligibles). 

For all types of income except Supplemental Security Income, households 
with income had more overpayments and underpayments, than did 
households without income. 

Characteristics that were related to the amount of overpayments were often 
related to the amount of underpayments. Thus, these characteristics appear to 
be indicators of a general tendency toward error, and overpayments to a group 
of people are partially offset by underpayments to people in the same group. 

Most characteristics were related to the amount of error and the incidence of 
error in a similar manner. Likewise, characteristics associated with 
overissuances to eligibles were usually associated with payments to ineligibles in 
the same direction. The only meaningful exception was in connection with 
household size: households with more members had higher payments to 
ineligibles but smaller overissuances to eligibles than households with fewer 
members. 

The average amount of error was substantially higher several months after 
certification or recertif ication than at the time of, or in the first month after, 
re/certification. The average error amount was higher when the most recent 
action was initial certification rather than recertification. 

These characteristics usually had a similar relationship to errors for both PA and 
NPA cases. The magnitude of the impact on errors of having earnings was 
substantially greater for PA cases than for NPA cases. 



The reader should not confuse variance with the "variances" reported by QC reviewers. 
We use variance in its statistical sense here. For the nontechnical reader, variance is a 
measure of the degree to which individual scores on a variable are spread around the 
average score. 



VI-3 



Table of Contents 



Attributing Dollar Error to Sources of Error 

Under the QC system, reviewers only determine the total amount of error in a case. 
They do not apportion the dollar amount among the various types of error that may be 
present in a case. The report develops a regression-based analytical technique for 
attributing dollar error to sources of error. The application of this technique to the QC 
database results in the findings below. 

o Errors in earned income were even more important in accounting for dollar error 
than their simple frequency would suggest. Earned income errors accounted for 
22 percent of PA errors and 26 percent of NPA errors, but the size of the errors 
meant that earned income errors accounted for 39 percent and M percent of the 
cost of PA and NPA errors, respectively. 

o Over 70 percent of the dollar value of overpayments were attributable to client- 
caused errors. Approximately one-third of dollar overpayments were 
attributable to client-caused earned income errors. 

o Errors that occurred after the most recent certification (that is, errors due to 
an unreported change in client circumstances) were larger than those that 
occurred at the most recent certification (for example, due to incorrectly 
reported client cicumstances). 



Conclusion 

This picture of the patterns of error, household characteristics, and the relationship 
among them should strengthen efforts to control errors in the Food Stamp Program. As 
findings are discussed by policymakers and program managers, implications for error 
control techniques should emerge. These preliminary analyses are also an extremely 
useful first step in our study of FSP certification and recertification error control 
activities and demonstrate the relevance of our study sample for commenting on FSP 
cases more broadly. Finally, understanding the substantial differences in the dollar value 
attributable to different sources of error will enable us to concentrate our further study 
on identifying ways to reduce the most costly types of errors in the Food Stamp Program. 
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Appendix A 



Comparison of Estimates of the Linear Probability Model 
and the Logistic Model 
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Appendix A 



Comparison of Estimates of the Linear Probability Model 
and the Logistic Model 



In Section IV we presented estimates of the relationship between case 
characteristics and the incidence of errors. These estimates were based on 
the linear probability model and were estimated by ordinary least squares 
(0LS).~ However, the linear probability model suffers from two 
deficiencies. First, predicted probabilities can fall outside of the 
interval from zero to 1. Second, the error terms in the model are 
necessarily heteroscedastic (i.e., the variance of the error term varies 
among cases); consequently, the estimates of the parameters are inefficient, 
and the estimated standard errors of the parameters are biased. Despite 
these deficiencies, OLS was used to estimate the relationship between case 
characteristics and errors because of its relatively low cost and ease of 
interpretation. 

In this appendix, we compare the OLS estimates with estimates of a 
model that does not suffer from any of these deficiencies— the logit model. 
The logit model represents the probability that an error occurs (P(E)) by: 

e XB 

P(E) = -7*— (1) 

e XB +l 

Where X is the vector of independent variables believed to affect the 
probability, and B is a vector of parameters to be estimated. By 
construction, P(E) is contained in the interval (0, 1). In contrast, the 
linear probability model is given by: 
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P L (E) = Xd (2) 

Where d is a vector of parameters. P L is not constrained to lie in the 
interval (0, 1 ). 

Table A-l presents logit estimates of the relationship between case 
characteristics and whether any error occurs (overpayment or underpayment). 
The first two columns of the table present the logit estimates of the 
coefficients of the case characteristics and their standard errors. The 
last two columns present the OLS estimates and standard errors, which were 
originally presented in Table IV-3. However, the two sets of coefficients 
are not directly comparable. Because the OLS coefficients represent the 
average effect of a one unit change in a case characteristic, corresponding 
effects of a unit change are presented for the logit model in the middle 
column of the table, entitled "Transformed Logit Coefficients." These unit 
effects are calculated as the difference between the predicted probabilities 
at the means of the other case characteristics when the case characteristic 
changes by 1. Thus, for categorical case characteristics these numbers 
represent the percentage point difference in the probability of having an 
error between cases with the characteristic and cases without the 
characteristic, evaluating all other variables at their means. The results 
indicate that the effects of the case characteristics on errors estimated 
using the logit model are very similar to the effects estimated by OLS. 
Thus, the two models have virtually identical implications. 
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Table A-l 

COMPARISON OF BINOMIAL LOGIT AND OROINARY LEAST SQUARES ESTIMATES ON 

INDIVIDUALS EITHER OVER- OR UNDERISSUED OR INELIGIBLE FOR NPA CASES 

(Standard Errors in Parentheses) 



Independent Variable 

Demographic characteristics 

Household size 

Whether aliens 

Race 

White 
Black 
Hispanic 
Other nonwhite 



Looit Coefficients 



Transformed Logit 
Coefficients 



.23** 


(.03) 


4.3 


.18** 


(.06) 


3.5 


.09 


(.08) 


1.8 



OLS Coefficients 



.15** 


(.01) 


2.8% 


3.15** 


(0.3) 


-.20 


(.07) 


-0.4 


-0.4 


(1.2) 



4.1** (0.5) 
3.2** (1.1) 
1.7 (1.4) 



Whether have income 

Earned income 

Less than $500/month 
$500/month or more 

RSOI or pensions 

SSI 

Other income 



.54* 
.51* 

.04 

.45* 

.28* 



(.04) 
(.04) 

(.03) 

(.03) 

(.03) 



11.1 
10.3 

0.7 

-8.1 

5.4 



10.4** 
10.2** 

0.4 

-8.0** 
5.1** 



(0.8) 
(0.8) 

(0.6) 

'(0.6) 

(0.6) 



Whether have deductions 

Shel ter 

Medical 
Whether have net income 
Whether have liquid resources 
Food Stamp allotment (JlOO's) 



21** 


(.04) 


3.8 


3.7** 


(0.7) 


21** 


(.05) 


4.0 


3.3** 


(0.9) 


25** 


(.04) 


4.5 


4.3** 


(0.7) 


19** 


(.03) 


-3.5 


-3.5** 


(0.5) 


02 


(.03) 


0.3 


0.2 


(0.6) 
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Independent Variable 

Certification characteristics 

length of certification 
peri od 



Time from certification to 
QC review for initial 
certifications 



Table A-l (Concluded) 



Transformed Logi t 
Logit Coefficients Coefficients 



.02* 



i'.OO) 



0.3 



OLS Coefficients 



0.3' 



(0.1) 



Certified same month or 








1 month before review 


-.03 


(.06) 


-0.6 


Certified 2-3 months 








before review 


.45" 


(.06) 


9.1 


Certified 4-6 months 








before review 


.91" 


(.07) 


19.9 


Certified 7 or more 








months before review 


.82" 


(.09) 


17.9 



-0.6 


(1.0) 


7.4" 


(1.0) 


16.8" 


(1.3) 


14.4" 


(1.7) 



Time from recertification 
to QC review for ongoing 
cases 



Recertified same month 








or 1 month before 








review 


— 


— 


— 


Recertified 2-3 months 








before review 


.43" 


(.04) 


8.6 


Recertified 4-6 months 








before review 


.64" 


(.05) 


12.9 


Recertified more than 7 








months before review 


.51** 


(.06) 


10.4 



significant at the 51 level. 
"Significant at the IS level, 



7.4" (0.8) 

11.2" (0.9) 

8.6" (1.0) 
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Appendix B 



Estimated Standard Errors for Models of the Relationship Between 
Case Characteristics and the Amount and Incidence of Error 
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Table B-1 

STANDARD ERRORS OF THE ESTIMATED IMPACTS OF CASE CHARACTERISTICS ON AMOUNT OF UNDERPAYMENT 
ERROR, OVERPAYMENT ERROR AND TOTAL ERROR FOR NPA AND PA CASES 







NPA Cases 






PA Cases 






All 

Errors 


Under- 
payment 


Over- 
payment 


All 


Under- 
payment 


Over- 
payment 


Case Characteristics 




* 




Demographic characteristics 




Household size 


$0.17 


$0.07 


$0.17 


$0.18 


$0.06 


$0.17 


Whether aliens 


0.87 


0.35 


0.83 


0.95 


0.36 


0.91 


Race 














Wliite 
Black 
Hispanic 
Other nonwhite 


0.38 
0.75 
0.98 


0.15 
0.30 
0.39 


0.36 
0.72 
0.93 


0.45 
0.67 
0.91 


0.17 
0.25 
0.34 


0.43 
0.64 
0.87 



Whether have income 
Earned income 



Less than $500/month 
$500/month or more 


0.54 
0.59 


0.21 
0.23 


0.51 
0.56 


0.62 
0.90 


0.23 
0.34 


0.59 
0.86 


RSOI or pensions 


0.43 


0.17 


0.41 


0.59 


0.22 


0.56 


SSI 


0.40 


0.16 


0.38 


0.68 


0.26 


0.65 


Other income 


0.43 


0.17 


0.41 


0.61 


0.23 


0.58 


Whether have deductions 














Shelter 


0.46 


0.18 


0.44 


0.62 


0.23 


0.59 


Medical 


0.60 


0.24 


0.57 


1.60 


0.60 


1.53 


Whether have net income 


0.47 


0.19 


0.45 


0.53 


0.20 


0.50 


Whether have liquid resources 


0.34 


0.13 


0.33 


0.47 


0.18 


0.45 



Food Stamp allotment 



0.42 



0.17 



0.40 



0.44 



0.16 



0.42 
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Table B-1 (Concluded) 



Case Characteristics 

Certification characteristics 

Length of certification 
period 

Time from certification to 
QC review for initial 
certi fications 

Certified same month or 

1 month before review 
Certified 2-3 months 

before review 
Certified 4-6 months 

before review 
Certified 7 or more 

months before review 

Time from recertl fication 
to QC review for ongoing 
cases 



NPA Cases 

All Under- Over- 
Errors payment payment 



PA Cases 



0.05 



0.02 



0.05 



All 



0.05 



Under- 
payment 



0.02 



Over- 
payment 



0.05 



0.71 


0.28 


0.68 


0.98 


0.37 


0.94 


0.69 


0.27 


0.56 


0.89 


0.33 


0.85 


0.91 


0.36 


0.87 


1.09 


0.41 


1.04 


1.17 


0.47 


1.12 


1.44 


0.54 


1.38 



Recertified same month 








or 1 month before 








review 


-- 


-- 


-- 


Recertified 2-3 months 








before review 


0.54 


0.21 


0.52 


Recertified 4-6 months 








before review 


0.64 


0.25 


0.61 


Recertified more than 7 








months before review 


0.71 


0.28 


0.68 



0.60 0.23 0.58 
0.67 0.25 0.64 
0.86 0.32 0.82 



Note: These are estimated standard errors of the impact estimates presented in Table 1V-1 . 
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Table B-2 

STANDARD ERRORS OF ESTIMATED IMPACTS OF CASE CHARACTERISTICS ON AMOUNT OF OVERPAYMENT 
ERROR TO ELIGIBLES, INELIGIBLES AND OVERALL FOR NPA AND PA CASES 

NPA Cases PA Cases 





All 


Eligibles 


Ineligibles 


All 


Eligibles 


Inel igibles 


Case Characteristics 














Demographic characteristics 




Household size 


SO. 17 


$0.09 


$0.14 


$0.17 


$0.10 


$0.14 


Whether alien 


0.83 


0.48 


0.72 


0.91 


0.56 


0.74 



Race 



White 
Black 
Hispanic 
Other nonwhite 



Whether have income 

Earned Income 

Less than $500/month 
$500 /mo nth or more 

RSD1 or pensions 

SSI 

Other income 

Wnether have deductions 

Shelter 

Medical 
Whether have net income 
Whether have liquid resources 
Food Stamp allotinent amount 



0.36 


0.21 


0.32 


0.43 


0.26 


0.35 


0.72 


0.41 


0.62 


0.64 


0.40 


0.52 


0.93 


0.53 


0.81 


0.87 


0.54 


0.71 



0.51 
0.56 


0.29 
0.32 


0.45 
0.49 


0.59 
0.86 


0.37 
0.53 


0.48 
0.70 


0.41 


0.23 


0.35 


0.56 


0.35 


0.46 


0.38 


0.22 


0.33 


0.65 


0.40 


0.53 


0.41 


0.23 


0.35 


0.58 


0.36 


0.47 



0.44 


0.25 


0.38 


0.59 


0.37 


0.48 


0.57 


0.33 


0.50 


1.53 


0.95 


1.25 


0.45 


0.26 


0.39 


0.50 


0.31 


0.41 


0.33 


0.19 


0.29 


0.45 


0.28 


0.37 


0.40 


0.23 


0.35 


0.42 


0.26 


0.34 
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Table B-2 (Concluded) 



Case Characteristics 

Certification characteristics 

Length of certification 
period 

Time from certification to 
QC review for initial 
certl fications 



NPA Cases 



Al 1 Eligibles Ineligibles 



0.05 



0.03 



0.04 



0.05 



PA Cases 



All El igibles Inel igibles 



0.03 



0.04 



Certified same month or 

1 month before review 
Certified 2-3 months 

before review 
Certified 4-6 months 

before review 
Certi fied 7 or more 

months before review 



0.68 


0.39 


0.59 


0.94 


0.58 


0.76 


0.66 


0.38 


0.57 


0.85 


0.53 


0.69 


0.87 


0.50 


0.76 


1 .04 


0.64 


0.85 


1.12 


0.64 


0.97 


• 1.38 


0.86 


1.12 



Time from recertification 
to QC review for ongoing 
cases 

Recertified same month 
or 1 month before 
review 



Recertified 2-3 months 

before review 
Recertified 4-6 months 

before review 
Recertified 7 or more 

months before review 



0.52 


0.30 


0.45 


0.58 


0.36 


0.47 


0.61 


0.35 


0.53 


0.64 


0.40 


0.52 


0.68 


0.39 


0.59 


0.82 


0.51 


0.67 



Note: These are estimated standard errors of the impact estimates presented in Table IV-2. 
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Table 8-3 

STANDARD ERRORS OF THE ESTIMATED IMPACTS OF CASE CHARACTERISTICS ON THE INCIDENCE OF 
UNDERPAYMENT ERROR, OVERPAYMENT ERROR, AND ANY ERROR FOR NPA AND PA CASES 





cs 




NPA Cases 






PA Cases 






All 

Errors 


Under- 
payment 


Over- 
payment 


All 


Under- 
payment 


Over- 
payment 


Case Characterise 








Demographic character] 


sties 




Household size 




.25% 


.15% 


.22% 


.24% 


.15% 


.21% 


Whether aliens 




1.23 


.74 


i.n 


-• 1.27 


.81 


1.11 


Race 
















White 
Black 
Hispanic 
Other nonwhite 




.54 
1.06 
1.38 


.32 
.64 
.83 


.49 

.96 

1.24 


.60 

.90 

1.22 


.38 
.57 
.78 


.52 

.79 

1.07 



Whether have Income 

Earned income 

Less than $500/month 
$500/month or more 

RSOI or pensions 

SSI 

Other income 



76 


.46 


.69 


.83 


.53 


.72 


83 


.50 


.75 


1.21 


.77 


1.05 


60 


.36 


.54 


.79 


.50 


.69 


57 


.34 


,51 


.92 


.58 


.80 


60 


.36 


.55 


.82 


.52 


.71 



Whether have deductions 

Shelter 

Medical 

Whether have net income 

Whether have liquid resources 

Food Stamp allotment amount 
(JlOO's) 



.65 


.39 


.59 


.83 


.53 


.73 


.85 


.51 


.76 


2.15 


1.36 


1.87 


.67 


.40 


.61 


.71 


.45 


.62 


.49 


.29 


.44 


.63 


.40 


.55 



.59 



.36 



.54 



.59 



.37 



.52 
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Table B-3 (Concluded) 



NPA Cases 



PA Cases 



Case Characteristics 

Certification characteristics 

Length of certification 
period 

Time from certification to 
QC review for 1ni tial 
certifications 

Certified same month or 

1 month before review 
Certified 2-3 months 

before review 
Certified 4-6 months 

before review 
Certi f ied 7 or more 

months before review 

Time from recertification 
to QC review for ongoing 
cases 

Recertified same month 

or 1 month before 

review 
Recertified 2-3 months 

before review 
Recertified 4-6 months 

before review 
Recertified 7 or more 

months before review 



All 
Errors 



.08 



Under- 
payment 



.05 



Over- 
payment 



.07 



.77 .46 .69 

.90 .54 .81 

1.01 .60 .41 



All 



.07 



Under- 
payment 



.05 



Over- 
payment 



.06 



1.01 


.61 


.91 


1.32 


.84 


1.15 


.98 


.59 


.88 


1.20 


.76 


1.04 


1.29 


.77 


1.16 


1.46 


.93 


1.27 


1.65 


.99 


1.49 


1.93 


1.23 


1.69 



.81 


.52 


.71 


.90 


.57 


.79 


1.16 


.74 


1.01 



Note: These are estimated standard errors of the impact estimates presented in Table IV-3. 
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Table B-4 

STANDARD ERRORS OF THE ESTIMATED IMPACTS OF CASE CHARACTERISTICS ON THE INCIDENCE OF 
OVERPAYMENT ERRORS TO ELIGIBLES, INELIGIBLES AND OVERALL FOR NPA AND PA CASES 



NPA Cases 



PA Cases 





All 


Eligibles 


Ineligibles 


All 


El 


igibles 


Inel 


igibles 


Case Characteristics 


















Demographic characteristics 




Household size 


.221 


.19* 


.135 


.21% 




.1815 




.IIS 


Whether aliens 


1.11 


.96 


.67 


1.11 




.99 




.59 


Race 


















White 
Black 
Hispanic 
Other nonwhite 


.49 
.96 

1.24 


.42 

.83 
1.08 


.29 
.58 
.75 


.52 

.79 
1.07 




.46 
.70 
.95 




.27 
.41 
.56 



Whether have income 

Earned income 

Less than $500 /month 
$500/month or more 

RSDI or pensions 

SSI 

Other income 



69 

75 


.60 
.65 


.41 
.45 


.72 
1.05 


.64 
.94 


.38 

.56 


54 


.47 


.32 


.69 


.61 


.36 


51 


.44 


.31 


.80 


.71 


.42 


55 


.47 


.33 


.71 


.63 


.37 



Whether have deductions 

Shelter 

Medical 
Whether have net Income 
Whether have liquid resources 
Food Stamp allotment amount 

(Sioo's) 



59 


.51 


.35 


.73 


.65 


.38 


76 


.66 


.46 


1.87 


1.67 


.99 


61 


.52 


.36 


.62 


.55 


.33 


44 


.38 


.26 


.55 


.49 


.29 



.54 



.46 



.32 



.52 



.46 



.27 



B-7 



Table of Contents 



Table 8-4 (Concluded) 



MPA Cases 



All El igibles Inel igibles 



PA Cases 



Al 1 El i gibles Inel i gi'bles 



Case Characteristics 

Certification characteristics 

Length of certification 
period (months) 

Time from certification to 
QC review for initial 
certifications 



.07 



.06 



.04 



.06 



.06 



.03 



Certified same month or 

1 month before review 
Certified 2-3 months 

before review 
Certified 4-6 months 

before review 
Certi fied 7 or more 

months before review 



.91 


.79 


.55 


1.15 


1 .02 


.61 


.88 


.76 


.53 


1.04 


.93 


.55 


1.16 


1.01 


.70 


1.27 


1.13 


.67 


1.49 


1.29 


.90 


1.69 


1.50 


.89 



Time from recertif ication 
to QC review for ongoing 
cases 



Recertified same month 

or 1 month before 

review 
Recertified 2-3 months 

before review 
Recertified 4-6 months 

before review 
Recertified more than 7 

months before review 



69 


.60 


.42 


.71 


.63 


.37 


81 


.70 


.49 


.79 


.70 


.42 


91 


.78 


.54 


1.01 


.90 


.53 



Note: These are estimated standard errors of the impact estimates presented in Table IV-4. 
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Appendix C 
Estimated Impacts of First and Subsequent Errors on Dollar Errors 
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Table C-l 
ESTIMATED IMPACT OF FIRST AND SUBSEQUENT ERRORS ON OVERPAYMENT ERRORS BY SOURCE 





Source of Error 
Earned income 




NPA Cases 






PA Cases 






Estimated 

Amount of 

First Error 

54.21** 
(1.03) 


Estimated 
Amount of 
Subsequent 
Error 

15.42** 
(1.55) 


Percent of 
Errors of 
Specified 
Type that 
are First 
Errors 


Estimated 

Amount of 

First Error 

70.82** 
(1.24) 


Estimated 
Amount of 
Subsequent 
Error 

10.98** 
(2.15) 


Percent of 
Errors of 
Specified 
Type that 
are First 
Errors 




75.0 


78.3 


t-> 


Unearned income 


35.24** 
(1.18) 


4.42** 
(1.13) 


53.8 


40.52** 
(1.34) 


2.79* 
(1.39) 


56.7 


1 


Resources 


64.73** 
(1.82) 


7.24** 
(1.22) 


38.1 


89.41** 
(3.10) 


4.21* 
(1.85) 


33.7 




Deductions 


19.40** 
(1.60) 


-1.45 
(0.92) 


28.4 


20.50** 
(1.56) 


-2.63* 
(1.18) 


38.1 




Household size 


52.77** 
(2.23) 


30.36** 
(3.52) 


73.7 


69.41** 
(1.86) 


32.92** 
(3.16) 


77.6 




Other nonfinancial 


85.64** 
(4.32) 


1.02 
(6.08) 


66.7 


86.48** 
(4.48) 


16.64* 
(7.07) 


72.3 




Computations 


37.36** 
(4.82) 


7.61* 
(3.71) 


38.4 


42.30** 
(4.67) 


2.23 
(4.20) 


46.7 



*Significant at the 5% level. 
**Significant at the 1% level. 
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Table C-2 
ESTIMATED IMPACT OF FIRST AND SUBSEQUENT ERRORS ON TOTAL ERROR BY SOURCE OF ERROR 



i 







NPA Cases 






PA Cases 










Percent of 






Percent of 


Source of Error 


Estimated 

Amount of 

First Error 

$50.00** 
(0.81) 


Estimated 
Amount of 
Subsequent 
Error 


Errors of 
Specified 
Type that 
are First 
Errors 


Estimated 

Amount of 

First Error 

$63.63** 
(0.97) 


Estimated 
Amount of 
Subsequent 
Error 


Errors of 
Specified 
Type that 
are First 
Errors 


Earned income 


$12.81** 
(1.25) 


75.9% 


$9.80** 
(1.65) 


74.4% 


Unearned income 


34.02** 
(0.96) 


3.62** 
(0.92) 


53.4 


37.62** 
(1.04) 


2.31* 
(1.06) 


56.4 


Resources 


62.92** 
(1.61) 


5.90** 
(0.97) 


33.4 


84.00** 
(2.64) 


2.85 
(1.46) 


29.0 


Deductions 


18.33** 
(1.11) 


-0.97 
(0.73) 


34.1 


20.13** 
(1.00) 


-2.63** 
(0.85) 


44.6 


Household size 


51.27** 
(1.62) 


29.83** 
(2.78) 


77.2 


62.60** 
(1.28) 


34.03** 
(2.55) 


82.6 


Other nonfinancial 


80.75** 
(3.79) 


0.84 
(4.76) 


61.3 


80.30** 
(3.79) 


8.67 
(5.26) 


66.7 


Computations 


32.57** 
(3.38) 


6.41* 
(2.91) 


43.4 


35.40** 
(3.07) 


-1 .22 
(2.98) 


49.9 



*Significant at the 5% level. 
**Si gni f icant at the 1% level. 
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Table C-3 
IMPACT OF FIRST AND SUBSEQUENT ERRORS ON OVERPAYMENT ERROR BY CAUSE OF ERROR 



O 







NPA Cases 






PA Cases 




Cause of Error 


Estimated 

Amount of 

First Error 

$49.86** 
(0.90) 


Estimated 

Amount of 

Subsequent 

Error 


Percent of 
Errors of 
Specified 
Type that 
are First 
Errors 


Estimated 

Amount of 

First Error 

60.13** 
(1.07) 


Estimated 

Amount of 

Subsequent 

Error 


Percent of 
Errors of 
Specified 
Type that 
are First 
Errors 


Client-caused 


$9.64** 
(0.71) 


54.91 


10.11** 
(1.00) 


60.5 


Information not 
reported 


49.66** 
(1.07) 


12.99** 
(1.10) 


63.7 


64.31** 
(1.24) 


11.57** 
(1.34) 


65.9 


Information 
incompletely 
reported 


50.05** 
(1.38) 


7.32** 
(0.94) 


44.4 


51.54** 
(1.83) 


8.45** 
(1.50) 


51.0 


Other client error 


41.15** 
(6.69) 


12.20 
(6.48) 


57.3 


48.84** 
(8.48) 


14.03 
(8.75) 


54.5 


Agency -caused 


35.09** 
(1.13) 


1.51 
(0.81) 


46.3 


37.58** 
(1.22) 


5.92** 
(1.01) 


53.3 


Policy 
Incorrectly 
applied 


33.17** 
(1.87) 


1.95 
(1.34) 


42.2 


38.02** 
(2.14) 


4.12* 
(1.77) 


51.2 


Failed to follow 
up on Informa- 
tion provided 


38.14** 
(1.48) 


2.24 
(1.23) 


51.0 


38.31** 
(1.52) 


6.65** 
(1.44) 


56.3 


Arithmetic error 


25.82** 
(3.25) 


0.47 
(2.39) 


38.1 


29.77** 
(4.17) 


4.37 
(3.28) 


42.6 


Other agency error 


35.09** 
(4.75) 


-8.41 
(4.55) 


50.4 


37.33** 
(5.50) 


12.53** 
(4.61) 


46.8 



•Significant at the 51 level. 
"Significant at the It level. 
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Table C-4 
IMPACT OF FIRST AND SUBSEQUENT ERRORS ON TOTAL ERROR BY CAUSE OF ERROR 



o 
r 
-P. 







NPA Cases 






PA Cases 










Percent of 






Percent of 








Errors of 






Errors of 






Estimated 


Specified 




Estimated 


Sped fled 




Estimated 


Amount of 


Type that 


Estimated 


Amount of 


Type that 




Amount of 


Subsequent 


are First 


Amount of 


Subsequent 


are First 


Cause of Error 


First Error 
$46.45** 


Error 


Errors 


First Error 
$53.78** 


Error 


Errors 


CI lent-caused 


$8.41** 


54.9% 


$9.07** 


60. U 




(.72) 


(.57) 




(.83) 


(.78) 




Information not 


46.76** 


12.31** 


64.8 


57.02** 


10.96** 


65.8 


reported 


(.84) 


(.90) 




(.96) 


(1.05) 




Information 














incompletely 


45.61** 


5.85** 


42.9 


46.51** 


6.80** 


49.7 


reported 


(1.12) 


(.74) 




(1.44) 


(1.16) 




Other cl lent error 


38.20** 


10.08 


56.6 


40.48** 


13.74* 


59.4 




(5.39) 


(5.29) 




(5.79) 


(6.21) 




Agency-caused 


31.53** 


1.99** 


49.2 


33.55** 


4.75** 


56.2 




(.84) 


(.64) 




(.85) 


(.75) 




Policy 














Incorrectly 


29.51** 


2.11* 


46.1 


33.11** 


3.49** 


54.9 


appl led 


(1.35) 


(1.04) 




(1.45) 


(1.32) 




Failed to follow 














up on Informa- 


35.09** 


2.85** 


53.1 


35.00** 


5.06** 


58.4 


tion provided 


(1.14) 


(1.00) 




(1.07) 


(1.04) 




Arithmetic error 


23.47** 


.69 


41.8 


24.99** 


3.82 


48.7 




(2.34) 


(1.89) 




(2.69) 


(2.43) 




Other agency error 


29.04** 


-5.56 


56.1 


33.31** 


10.54** 


55.3 




(3.37) 


(3.63) 




(3.63) 


(3.51) 





*S1gn(flcant at the 51 level. 
"Significant at the 1% level. 
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Table C-5 

ESTIMATED IMPACT OF FIRST AND SUBSEQUENT ERRORS ON OVERPAYMENT 
ERRORS BY SOURCE AND CAUSE— NPA CASES 



Client-Caused Error 



Agency-Caused Error 



o 
I 
01 



Source of Error 
Earned income 



Unearned income 



Resources 



Deductions 



Household size 



Other nonfinancial 



Computation 



Estimated 

Amount of 

First Error 

57.62** 
(1.17) 

41.23** 
(1.55) 

62.55** 
(1.89) 

20.12** 
(2.16) 

52.91** 
(2.63) 

79.14** 
(5.38) 



Percent of 

Errors of 

Estimated Specified 

Amount of Type that 

Subsequent are First 



Error 



20.22** 
(2.23) 

8.42** 
(1.69) 

9.39** 
(1.58) 

-1.50 
(1.41) 

37.04** 
(4.45) 

-1.97 
(8.63) 



Error s 
78.7 

54.8 

42.6 

28.9 

73.7 

68.4 



Estimated 

Amount of 

First Error 

44.46** 
(1.82) 

28.48** 
(1.64) 

80.13** 
(5.44) 

19.06** 
(2.29) 

49.92** 
(3.94) 

93.95** 
(7.0) 

37.33** 
(4.78) 



Percent of 

Errors of 

Estimated Specified 

Amount of Type that 

Subsequent are First 



Error 



8.23** 
(2.76) 

0.84 
(1.71) 

-1.40 
(3.08) 

-0.10 
(1.40) 

8.10 
(7.41) 

6.43 
(10.57) 

9.25* 
(3.60) 



Errors 
66.9 

52.7 

19.5 

27.9 

73.6 

63.9 

38.4 



*Significant at the 5% level. 
**Significant at the H level. 
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Table C-6 

ESTIMATED IMPACT OF FIRST AND SUBSEQUENT ERRORS ON OVERPAYMENT 
ERRORS BY SOURCE AND CAUSE--PA CASES 



Client-Caused Error 



Agency-Caused Error 



o 
I 

en 









Percent of 






Percent of 








Errors of 






Errors of 






Estimated 


Specified 




Estimated 


Specified 




Estimated 


Amount of 


Type that 


Estimated 


Amount of 


Type that 




Amount of 


Subsequent 


are First 


Amount of 


Subsequent 


are First 


Source of Error 


First Error 
77.24** 


Error 
18.80** 


Errors 
81.0 


First Error 
55.16** 


Error 


Errors 


Earned income 


0.70 


72.7 




(1.42) 


(3.00) 




(2.10) 


(3.61) 




Unearned income 


50.39** 


4.14 


59.7 


31.61** 


3.84 


54.3 




(1.87) 


(2.32) 




(1.78) 


(1.91) 




Resources 


86.94** 


2.32 


37.2 


99.93** 


6.47 


18.8 




(3.21) 


(2.36) 




(9.10) 


(5.09) 




Deductions 


21.32** 


-3.08 


38.5 


19.58** 


-1.32 


37.7 




(2.18) 


(1.79) 




(2.13) 


(1.64) 




Household size 


74.98** 


37.09** 


78.2 


57.78** 


26.86** 


76.5 




(2.28) 


(4.31) 




(2.86) 


(5.34) 




Other nonfinancial 


84.97** 


16.39 


73.5 


86.36** 


11.04 


70.7 




(5.79) 


(9.67) 




(6.78) 


(11.13) 




Computation 


— 


-- 


— 


42.20** 
(4.60) 


4.32 
(4.15) 


46.7 



*Significant at the 5% level. 
**Signi ficant at the 1% level. 
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Table C-7 

ESTIMATED IMPACT OF FIRST AND SUBSEQUENT ERRORS ON TOTAL ERROR 
BY SOURCE AND CAUSE— NPA CASES 



Client-Caused Error 



Agency-Caused Error 



■ 



Source of Error 


Estimated 

Amount of 

First Error 

54.10** 
(0.94) 


Estimated 

Amount of 

Subsequent 

Error 

18.63** 
(1.83) 


Percent of 
Errors of 
Specified 
Type that 
are First 
Errors 


Estimated 

Amount of 

First Error 

40.38** 
(1.35) 


Estimated 

Amount of 

Subsequent 

Error 

5.53** 
(2.12) 


Percent of 
Errors of 
Specified 
Type that 
are First 
Errors 


Earned income 


79.2 


69.2 


Unearned income 


40.41** 
(1.29) 


6.69** 
(1.40) 


53.7 


27.33** 
(1.31) 


0.92 
(1.39) 


53.2 


Resources 


60.65** 
(1.67) 


7.93** 
(1.27) 


38.0 


79.54** 
(4.87) 


-1.56 
(2.42) 


15.9 


Deductions 


19.63** 
(1.55) 


-1.61 
(1.11) 


32.9 


17.30** 
(1.51) 


0.73 
(1.10) 


35.3 


Household size 


51.11** 
(1.90) 


33.99** 
(3.57) 


77.4 


49.91** 
(2.83) 


14.75* 
(5.74) 


76.7 


Other nonfinancial 


73.05** 
(4.66) 


2.00 
(6.66) 


63.2 


93.31** 
(6.30) 


-1.31 
(8.45) 


58.0 


Computation 


— 


— 


— 


32.71** 
(3.34) 


7.94** 
(2.90) 


43.5 



♦Significant at the 5% level 
^Significant at the 1% level 
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Table C-8 

ESTIMATED IMPACT OF FIRST AND SUBSEQUENT ERRORS ON TOTAL ERROR 
BY SOURCE AND CAUSE--PA CASES 



Client-Caused Error 



Agency-Caused Error 











Percent of 






Percent of 










Errors of 






Errors of 








Estimated 


Specified 




Estimated 


Specified 






Estimated 


Amount of 


Type that 


Estimated 


Amount of 


Type that 






Amount of 


Subsequent 


are First 


Amount of 


Subsequent 


are First 




Source of Error 


First Error 
70.82** 


Error 


Errors 
80.0 


First Error 
49.72** 


Error 


Errors 




Earned income 


16.26** 


1.95 


73.1 






(1.15) 


(2.35) 




(1.55) 


(2.69) 






Unearned income 


47.88** 


5.11** 


57.9 


30.35** 


2.03 


55.3 


o 

00 




(1.55) 


(1.86) 




(1.31) 


(1.42) 






Resources 


82.39** 


1.33 


32.5 


88.51** 


2.60 


15.7 






(2.74) 


(1.84) 




(7.52) 


(3.76) 






Deductions 


20.62** 


-3.03 


42.2 


19.77** 


-1.34 


46.4 






(1.51) 


(1.33) 




(1.28) 


(1.15) 






Household size 


66.08** 


37.04** 


82.6 


55.90** 


27.38** 


82.8 






(1.59) 


(3.48) 




(1.92) 


(4.34) 






Other nonfinancial 


77.43** 


10.54 


69.7 


82.66** 


3.20 


62.5 






(4.84) 


(7.52) 




(5.86) 


(8.10) 






Computation 


-- 


— 


-- 


35.39** 
(3.03) 


0.08 
(2.95) 


49.9 



*Significant at the 5% level 
**Signi ficant at the 1% level 



Table of Contents 



Table C-9 
IMPACT OF FIRST AND SUBSEQUENT ERRORS ON OVERPAYMENT ERROR BY TIMING OF ERROR 





Timing of Error 




NPA Cases 






PA Cases 




to 


Estimated 

Amount of 

First Error 

$45.24** 
(.93) 


Estimated 

Amount of 

Subsequent 

Error 

$5.27** 
(.60) 


Percent of 
Errors of 
Specified 
Type that 
are First 
Errors 


Estimated 

Amount of 

First Error 

$48.75** 
(1.11) 


Estimated 
Amount of 
Subsequent 
Error 


Percent of 
Errors of 
Specified 
Type that 
are First 
Errors 




At or before most 
recent certifi- 
cation 


46.3% 


$8.03** 
(.88) 


54. OX 




After most recent 
certification 


43.27** 
(1.11) 


9.97** 
(1.15) 


63.6 


53.98** 
(1.26) 


8.03** 
(1.22) 


63.1% 



**Significant at the 1% level. 
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Table C-10 
IMPACT OF FIRST AND SUBSEQUENT ERRORS ON TOTAL ERROR BY TIMING OF ERROR 









NPA Cases 






PA Cases 










Percent of 






Percent of 










Errors of 






Errors of 








Estimated 


Specified 




Estimated 


Specified 






Estimated 


Amount of 


Type that 


Estimated 


Amount of 


Type that 


o 




Amount of 


Subsequent 


are First 


Amount of 


Subsequent 


are First 


1 

t — • 


Timing of Error 


First Error 
$39.63** 


Error 
$4.82** 


Errors 


First Error 
$41 .85** 


Error 
$7.47** 


Errors 


o 


At or before most 


47. 2% 


55.1% 




recent recertifi- 


(.73) 


(.48) 




(.82) 


(.67) 






cation 
















After most recent 


41.56** 


9.56** 


64.6 


46.82** 


6.28** 


63.4% 




certification 


(.86) 


(.92) 




(.93) 


(.91) 





^Significant at the 1% level. 



